-- Logs begin at Fri 2021-12-24 04:20:00 UTC, end at Fri 2021-12-24 05:29:02 UTC. -- Dec 24 04:50:58.741115 dv-cinder-816443-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 24 04:50:58.751019 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Dec 24 04:50:58 2021] *** Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: nodename: dv-cinder-816443-2-iscsi Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: machine: x86_64 Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: clock source: unix Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: pcre jit disabled Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: detected number of CPU cores: 4 Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: current working directory: / Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: detected binary path: /usr/bin/uwsgi-core Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: your processes number limit is 47680 Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: your memory page size is 4096 bytes Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: detected max file descriptor number: 2048 Dec 24 04:50:58.753076 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: lock engine: pthread robust mutexes Dec 24 04:50:58.753909 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: thunder lock: enabled Dec 24 04:50:58.753909 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 24 04:50:58.753909 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 24 04:50:58.797636 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: Python main interpreter initialized at 0x5597821da9c0 Dec 24 04:50:58.797636 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: python threads support enabled Dec 24 04:50:58.797636 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: your server socket listen backlog is limited to 100 connections Dec 24 04:50:58.797636 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: your mercy for graceful operations on workers is 90 seconds Dec 24 04:50:58.798007 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: mapped 403077 bytes (393 KB) for 2 cores Dec 24 04:50:58.798007 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: *** Operational MODE: preforking *** Dec 24 04:50:58.798304 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: *** uWSGI is running in multiple interpreter mode *** Dec 24 04:50:58.798304 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: spawned uWSGI master process (pid: 101737) Dec 24 04:50:58.798508 dv-cinder-816443-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 24 04:50:58.799098 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: spawned uWSGI worker 1 (pid: 101738, cores: 1) Dec 24 04:50:58.799368 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: spawned uWSGI worker 2 (pid: 101739, cores: 1) Dec 24 04:50:58.799523 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 24 04:51:00.500444 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:51:00.500444 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: from cryptography.utils import int_from_bytes Dec 24 04:51:00.501158 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:51:00.501158 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: from cryptography.utils import int_from_bytes Dec 24 04:51:00.505980 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:51:00.505980 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: from cryptography.utils import int_from_bytes Dec 24 04:51:00.506514 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:51:00.506514 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: from cryptography.utils import int_from_bytes Dec 24 04:51:03.052933 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:51:03.053539 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:51:03.053635 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:51:03.053998 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:51:03.054252 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:51:03.054631 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.054995 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.055133 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:51:03.055521 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.055610 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:51:03.055685 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.055848 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:51:03.055990 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.056212 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:51:03.056355 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.056438 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:51:03.056505 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.056852 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.057009 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.057171 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.057297 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.057444 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.057586 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.057734 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.057856 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.058042 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-2-iscsi {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.058148 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.058372 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.058461 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.058676 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.058767 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.058980 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.059078 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.059294 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.059392 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.059591 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.059682 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.059913 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.060001 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.060207 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.060295 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-2-iscsi {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.060551 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.060724 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.060886 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.061167 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.061301 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.061470 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.061596 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.061777 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.061892 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.062110 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.062241 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.062427 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.062519 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.062707 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.062907 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.063012 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.063228 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.063315 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.063540 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.063623 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.063856 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.063951 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.064197 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.064305 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-2-iscsi {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.064518 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.064636 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.064858 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.064948 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.065183 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.065268 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.065495 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.065637 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.065824 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.065946 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.066136 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.066255 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.066536 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-2-iscsi {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.066630 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.066856 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.066949 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.067164 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.067271 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.067474 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.067570 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.067786 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.067884 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.068107 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.068245 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.068427 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.068544 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.068752 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.068869 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.069058 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.069150 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.069361 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.069460 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.069688 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.069779 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.069976 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.070068 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.070275 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.070479 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.070582 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.070855 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.071002 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.071163 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.071331 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.071477 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.071666 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.071769 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.071974 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.072097 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.072224 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.072407 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.072561 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.072746 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.072833 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.073002 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.073086 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.073318 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.073406 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.073645 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.073737 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.073970 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.074061 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.074275 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.074362 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.074539 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.074624 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.074795 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.074897 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.075121 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.075209 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.075444 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.075529 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.075758 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.075842 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.076068 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.076153 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.076377 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.076469 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.076787 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.076884 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.077015 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.077099 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.077328 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.077423 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.077639 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.077735 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.077940 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.078034 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.078262 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.078356 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.078577 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.078673 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.078883 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.078968 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.079200 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.079293 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.079518 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.079605 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.079823 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.079908 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.080125 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.080219 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.080430 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.080514 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.080773 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.080860 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.081106 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.081205 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.081408 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.081494 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.081656 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.081741 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.081959 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.082053 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.082261 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.082346 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.082579 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.082665 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.082883 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.082976 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.083186 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.083277 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.083488 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.083573 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.083786 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.083873 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.084417 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.084503 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.084744 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.084841 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.085051 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.085144 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.085353 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.085437 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.085656 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.085741 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.086059 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.086166 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.086381 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.086611 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.086712 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.086859 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.086985 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.087165 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.087297 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.087484 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.087610 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.087802 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.087924 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.088107 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.088235 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.088416 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.088555 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.088746 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.088850 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.089051 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.089153 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.089370 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.089472 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.089674 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.089778 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.089977 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.090068 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.090294 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.090385 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.090598 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.090689 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.090899 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.090989 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.091214 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.091306 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.091518 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.091618 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.091822 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.091912 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.092142 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.092233 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.092440 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.092560 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.092768 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.092858 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.093083 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.093176 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.093386 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.093484 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.093688 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.093778 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.093990 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.094087 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.094290 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.094382 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.094591 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.094680 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.094894 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.094983 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.095193 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.095299 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.095494 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.095593 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.095792 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.095890 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.096123 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.096254 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.096432 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.096607 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.096768 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.096911 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.097076 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.097217 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.097380 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.097511 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.097652 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.097758 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.097980 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.098113 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.098297 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.098429 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.098597 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.098703 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.098923 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.099055 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.099236 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.099379 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.099555 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.099688 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.099870 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:03.100002 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.100143 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.100227 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.100455 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.100578 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.100801 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.100905 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.101115 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.101204 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.101423 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.101512 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.101873 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.102019 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.102232 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.102509 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.102598 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.102820 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.102951 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.103149 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.103280 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.103465 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.103596 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.103782 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.103923 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.104095 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.104252 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.104423 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.104610 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.104725 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.104923 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.105055 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.105272 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.105421 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.105593 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.105683 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.105915 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.106012 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.106271 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.106373 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.106598 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.106685 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.106929 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.107018 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.107254 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.107355 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.107567 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.107655 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.107894 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.107989 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.108214 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.108311 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.108548 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.108689 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.108877 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.108980 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.109196 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.109291 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.109519 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.109606 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.109837 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.109925 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.110135 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.110220 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.110450 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.110533 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.110773 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.110855 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.111086 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.111177 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.111397 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.111480 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.111714 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.111808 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.112031 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.112115 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.112343 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.112426 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.112676 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.112777 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.112988 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.113072 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.113297 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.113380 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.113611 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.113703 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.113921 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.114012 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.114237 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.114327 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.114557 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.114654 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.114865 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.114950 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.115181 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.115266 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.115496 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.115582 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.115804 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.115894 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.116119 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.116202 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.116428 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.116513 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.116760 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.116847 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.117072 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.117154 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.117547 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.117713 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.117949 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.118197 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.118285 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.118526 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.118620 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.118846 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.119033 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.119179 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.119345 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.119488 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.119668 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.119959 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.120106 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.120425 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.120773 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.121349 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.121448 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.121529 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.121708 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.122044 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.122901 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.122901 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.123087 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.123155 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.123318 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.123471 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.123638 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.124973 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125095 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125095 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125095 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125095 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125383 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125461 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125562 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125647 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125871 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.125962 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.126180 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.126266 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.126487 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.126601 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.126793 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.126924 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.127101 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.127250 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.127428 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.127568 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.127744 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.127885 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.128053 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.128187 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.128359 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.128507 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.128766 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.128896 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.129126 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.129220 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.129439 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.129523 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.129748 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.129838 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.130060 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.130144 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.130392 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.130483 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.130737 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.130877 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.131062 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.131165 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.131414 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.131543 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.131725 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.131871 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.132077 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.132199 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.132390 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.132544 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.132764 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.132987 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.133405 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.133501 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.133972 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.134070 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.134307 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.134400 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.134634 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.134719 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.134958 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.135048 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.135277 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.135365 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.135596 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.135680 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.135906 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.136015 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.136225 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.136310 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.136572 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.136661 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.136892 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.136976 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.137218 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.137305 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.137535 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.137621 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.137854 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.137951 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.138167 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.138292 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.138478 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.138563 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.138783 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.138875 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.139102 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.139185 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.139418 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.139502 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.139747 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.139842 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.140060 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.140166 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.140384 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.140478 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.140722 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.140820 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.141041 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.141126 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.141354 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.141438 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.141667 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.141758 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.141972 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.142065 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.142284 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.142369 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.142607 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.142693 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.142920 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.143012 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.143240 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.143370 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.143555 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.143641 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.143876 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.143959 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.144185 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.144294 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.144494 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.144605 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.144825 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.144910 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.145134 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.145217 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.145446 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.145531 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.145760 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.145851 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.146080 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.146172 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.146394 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.146479 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.146709 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.146793 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.147018 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.147110 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.147328 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.147411 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.147638 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.147721 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.147943 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.148105 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.148246 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.148328 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.148702 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.148798 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.149041 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.149273 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.149367 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.149624 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.149715 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.149942 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.150035 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.150254 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.150339 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.150576 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.150661 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.150891 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.150988 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.151202 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.151287 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.151507 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.151591 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.151818 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.151913 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.152125 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.152210 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.152440 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.152544 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.152791 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.152889 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.153099 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.153183 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.153414 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.153497 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.153775 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.153870 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.154039 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.154122 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.154347 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.154431 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.154655 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.154747 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.154964 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.155055 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.155272 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.155356 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.155592 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.155683 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.155905 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.155989 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.156210 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.156294 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.156573 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.156662 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.156857 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.156942 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.157169 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.157270 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.157487 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.157571 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.157798 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.157879 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.158107 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.158200 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.158418 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.158502 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.158725 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.158809 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.159034 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.159125 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.159348 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.159432 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.159661 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.159927 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.160010 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.160270 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.160355 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.160617 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.160703 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.160936 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.161038 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.161250 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.161341 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.161564 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.161648 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.161871 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.161964 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.162185 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.162269 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.162505 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.162590 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.162817 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.163084 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.163169 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.163423 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.163507 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.163727 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.163810 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.164044 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.164307 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.164576 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.164840 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.165144 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.165241 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.165500 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.165612 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.165837 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.165941 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.166154 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.166252 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.166469 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.166555 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.166786 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.166869 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.167096 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.167189 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.167402 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.167497 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.167718 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.167809 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.168027 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.168118 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.168335 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.168427 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.168665 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.168754 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.168981 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.169068 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.169291 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.169377 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.169596 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.169683 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.169932 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.170015 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.170243 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.170341 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.170562 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.170647 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.170871 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.170955 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.171185 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.171277 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.171491 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.171589 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.171820 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.171906 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.172132 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.172218 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.172438 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.172557 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.172768 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.172853 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.173073 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.173168 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.173380 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.173470 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.173695 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.173780 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.174008 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.174093 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.174316 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.174400 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.174631 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.174714 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.174944 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.175032 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.175259 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.175342 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.175572 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.175668 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.175875 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.175958 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.176182 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.176273 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.176487 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.176611 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.176822 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.176913 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.177134 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.177219 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.177436 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.177528 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.177749 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.177861 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.178058 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.178163 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.178366 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.178458 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.178673 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.178803 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.178980 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.179064 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.179282 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.179367 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.179585 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.179670 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.180006 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.180174 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.180324 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.180657 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.180762 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.180971 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.181055 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.181279 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.181376 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.181588 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.181673 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.181898 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.181988 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.182207 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.182299 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.182511 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.182595 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.182814 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.182904 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.183122 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.183212 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.183426 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.183510 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.183727 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.183816 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.184029 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.184113 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.184341 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.184425 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.184679 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.184766 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.184988 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.185073 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.185298 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.185381 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.185607 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.185690 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.185911 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.185995 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.186214 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.186298 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.186526 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.186620 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.186830 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.186921 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.187134 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.187224 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.187440 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.187533 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.187749 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.187834 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.188056 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.188139 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.188359 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.188450 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.188698 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.188785 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.189005 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.189099 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.189311 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.189403 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.189615 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.189698 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.189923 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.190005 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.190228 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.190314 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.190531 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.190614 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.190835 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.190925 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.191141 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.191226 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.191446 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.191538 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.191770 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.191854 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.192081 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.192166 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.192387 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.192479 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.192720 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.192806 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.193026 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.193113 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.193372 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.193457 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.193677 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.193770 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.194008 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.194091 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.194318 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.194401 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.194631 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.194729 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.194948 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.195032 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.195260 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.195498 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.195688 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.195864 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.196000 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.196183 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.196269 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.196495 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.196697 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.196847 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.196934 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.197161 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.197253 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.197479 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.197563 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.197789 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.197875 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.198096 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.198180 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.198407 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.198536 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.198720 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.198806 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.199035 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.199120 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.199347 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.199438 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.199663 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.199746 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.199972 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.200056 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.200277 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.200367 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.200618 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.200706 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.200928 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.201013 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.201238 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.201331 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.201552 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.201643 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.201856 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.201946 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.202166 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.202254 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.202470 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.202554 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.202779 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.202862 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.203084 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.203169 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.203393 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.203517 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.203700 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.203837 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.204014 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.204153 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.204328 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.204462 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.204658 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.204805 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.204987 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.205122 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.205301 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.205444 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.205609 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.205763 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.205919 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.206069 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.206225 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.206492 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.206578 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.206810 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.206896 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.207127 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.207252 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.207443 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.207568 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.207755 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.207885 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.208061 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.208193 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.208376 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.208505 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.208751 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.208839 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.209392 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.209482 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.209699 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.209791 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.210005 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.210090 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.210332 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.210470 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.210641 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.210785 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.211035 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.211330 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.211453 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.211777 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.211872 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.212084 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.212171 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.212423 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.212506 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.212766 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.212853 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.213099 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.213186 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.213413 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.213497 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.213725 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.213819 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.214034 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.214119 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.214364 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.214449 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.214672 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.214765 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.214981 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.215064 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.215312 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.215396 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.215642 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.215739 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.215960 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.216051 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.216277 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.216395 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.216615 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.216747 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.216948 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.217063 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.217275 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.217389 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.217596 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.217716 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.217923 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.218044 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.218339 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.218431 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.218652 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.218803 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.218966 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.219053 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.219287 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.219377 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.219613 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.219705 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.219921 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.220005 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.220227 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.220310 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.220557 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.220669 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.220860 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.220953 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.221168 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.221254 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.221494 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.221585 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.221799 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.221884 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.222117 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.222223 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.222431 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.222550 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.222744 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.222864 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.223055 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.223190 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.223362 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.223519 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.223688 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.223827 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.223997 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.224134 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.224327 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.224447 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.224670 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.224781 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.225001 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.225099 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.225328 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.225426 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.225640 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.225725 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.225970 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.226056 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.226284 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.226369 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.226658 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.226815 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.227045 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.227353 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.227454 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.227670 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.227755 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.227994 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.228077 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.228299 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.228390 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.228656 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.228745 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.228976 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.229073 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.229298 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.229389 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.229619 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.229711 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.229929 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.230014 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.230257 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.230342 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.230570 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.230670 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.230878 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.230972 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.231184 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.231269 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.231486 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.231570 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.231798 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.231882 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.232107 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.232193 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.232413 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.232496 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.232748 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.232845 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.233107 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.233201 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.233366 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.233450 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.233672 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.233766 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.233977 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.234069 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.234301 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.234386 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.234609 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.234702 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.234933 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.235018 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.235235 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.235324 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.235539 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.235636 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.235847 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.235940 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.236149 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.236240 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.236461 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.236579 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.236792 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.236878 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.237104 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.237190 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.237412 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.237497 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.237718 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.237802 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.238022 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.238107 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.238348 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.238434 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.238654 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.238746 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.238979 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.239071 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.239289 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.239382 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.239595 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.239727 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.239903 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.239989 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.240207 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.240293 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.240567 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.240655 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.240865 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.240961 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.241173 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.241258 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.241492 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.241584 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.241813 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.241909 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.242130 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.242251 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.242640 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.242732 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.243130 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.243262 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.243453 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.243540 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.243771 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.243863 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.244089 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.244188 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.244405 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.244489 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.244748 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.244888 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.245065 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.245213 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.245378 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.245532 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.245693 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.245847 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.246008 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.246164 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.246347 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.246489 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.246676 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.246809 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.247012 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.247334 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.247420 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.247662 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.247747 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.247976 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.248061 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.248289 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.248374 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.248632 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.248719 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.248946 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.249067 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.249260 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.249344 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.249573 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.249671 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.249884 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.249972 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.250195 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.250279 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.250507 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.250605 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.250823 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.250906 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.251141 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.251224 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.251458 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.251552 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.251773 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.251865 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.252087 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.252171 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.252398 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.252483 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.252738 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.252824 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.253054 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.253138 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.253380 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.253506 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.253717 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.253801 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.254025 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.254117 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.254338 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.254436 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.254652 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.254736 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.254963 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.255059 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.255275 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.255483 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.255569 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.255803 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.255887 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.256142 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.256234 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.256473 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.256593 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.256832 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.256917 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.257155 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.257241 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.257478 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.257562 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.257836 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.257939 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.258290 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.258376 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.258668 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.258803 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.258986 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.259133 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.259302 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.259451 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.259619 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.259762 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.260093 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.260186 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.260409 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.260494 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.260746 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.260843 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.261071 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.261166 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.261386 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.261471 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.261701 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.261926 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.262019 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.262284 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.262368 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.262608 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.262692 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.262912 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.263003 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.263228 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.263313 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.263540 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.263624 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.263845 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.263938 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.264168 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.264253 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.264477 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.264578 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.264804 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.264899 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.265122 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.265207 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.265431 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.265515 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.265736 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.265963 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.266048 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.266318 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.266446 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.266638 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.266732 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.266945 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.267029 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.267262 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.267346 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.267573 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.267665 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.267875 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.267959 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.268198 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.268280 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.268500 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.268655 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.268827 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.268913 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.269144 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.269229 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.269453 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.269571 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.269753 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.269836 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.270058 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.270141 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.270363 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.270451 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.270669 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.270760 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.270975 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.271065 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.271331 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.271418 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.271570 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.271656 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.271881 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.271977 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.272189 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.272274 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.272491 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.272642 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.272822 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.272917 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.273135 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.273220 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.273507 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.273599 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.273822 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.274075 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.274161 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.274446 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.274531 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.274760 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.274844 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.275074 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.275160 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.275381 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.275473 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.275695 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.275787 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.276005 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.276091 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.276326 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.276573 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.276662 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.276962 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.277048 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.277267 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.277353 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.277595 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.277679 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.277901 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.277987 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.278204 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.278290 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.278520 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.278605 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.278827 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.278916 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.279144 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.279230 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.279454 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.279537 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.279765 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.279850 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.280078 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.280163 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.280390 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.280483 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.280732 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.280963 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.281048 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.281343 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.281439 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.281656 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.281742 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.281970 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.282056 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.282289 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.282374 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.282632 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.282725 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.282942 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.283034 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.283254 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.283346 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.283569 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.283660 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.283885 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.283969 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.284195 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.284287 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.284506 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.284649 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.284840 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.284936 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.285151 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.285246 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.285461 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.285552 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.285774 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.285865 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.286092 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.286179 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.286398 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.286481 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.286713 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.286809 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.287059 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.287145 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.287380 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.287465 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.287700 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.287784 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.288020 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.288105 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.288339 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.288424 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.288682 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.288771 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.288995 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.289099 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.289347 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.289457 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.289733 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.289948 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.290177 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.290281 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.290522 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.290615 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.290857 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.290951 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.291191 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.291275 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.291500 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.291637 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.291808 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.291955 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.292115 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.292277 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.292427 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.292624 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.292792 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.292943 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.293133 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.293271 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.293454 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.293597 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.293782 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.293905 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.294101 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.294221 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.294426 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.294535 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.294739 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.294867 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.295065 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.295205 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.295393 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.295542 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.295713 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.295870 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.296028 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.296187 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.296362 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.296495 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.296701 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.296828 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.297019 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.297142 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.297336 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.297476 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.297650 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.297814 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.297961 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.298135 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.298273 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.298465 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.298600 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.298779 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.298927 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.299109 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.299237 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.299419 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.299567 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.299748 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.299888 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.300075 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.300212 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.300390 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.300548 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.300730 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.300863 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.301067 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.301195 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.301380 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.301509 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.301693 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.301830 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.302008 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.302144 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.302302 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.302457 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.302615 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.302776 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.302927 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.303142 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.303255 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.303422 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.303579 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.303749 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.303887 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.304079 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.304215 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.304406 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.304547 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.304910 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.305054 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.305247 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.305540 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.305626 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.305868 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.305996 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.306212 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.306309 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.306530 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.306638 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.306837 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.306972 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.307151 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.307364 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:51:03.307457 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.307774 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.308094 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.308425 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.308783 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.309111 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.309439 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.309787 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.310103 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.310449 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.310780 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.311097 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.311409 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.311880 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:03.312128 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:51:03.330596 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_db.sqlalchemy.engines [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.335630 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_db.sqlalchemy.engines [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.398406 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.context [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9562cd56-697c-4a0e-b853-980571393783(cell1) {{(pid=101738) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 04:51:03.401842 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.context [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9562cd56-697c-4a0e-b853-980571393783(cell1) {{(pid=101739) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 04:51:03.402755 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:51:03.404360 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:51:03.405203 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:51:03.406096 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_concurrency.lockutils [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:51:03.407167 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:51:03.407682 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_concurrency.lockutils [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:51:03.408487 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_concurrency.lockutils [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:51:03.410538 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_concurrency.lockutils [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:51:03.417888 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_db.sqlalchemy.engines [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.421611 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_db.sqlalchemy.engines [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.425673 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_db.sqlalchemy.engines [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.428104 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_db.sqlalchemy.engines [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.592688 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG oslo_db.sqlalchemy.engines [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.596468 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_db.sqlalchemy.engines [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:03.941844 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: WARNING keystonemiddleware.auth_token [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:51:03.948775 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: WARNING keystonemiddleware.auth_token [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:51:03.951325 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: WARNING keystonemiddleware.auth_token [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:51:03.957957 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: WARNING keystonemiddleware.auth_token [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:51:04.291478 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: WARNING keystonemiddleware.auth_token [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:51:04.296742 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: WARNING keystonemiddleware.auth_token [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:51:04.301914 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5597821da9c0 pid: 101739 (default app) Dec 24 04:51:04.304021 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:51:04.305478 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002013 Dec 24 04:51:04.306176 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Fri Dec 24 04:51:04 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:51:04.312098 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: WARNING keystonemiddleware.auth_token [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:51:04.316683 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: WARNING keystonemiddleware.auth_token [None req-929a5d69-7c2b-453a-a8bd-c93e05f7c893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:51:04.322010 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5597821da9c0 pid: 101738 (default app) Dec 24 04:52:31.596611 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:31.598322 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Dec 24 04:52:31.598878 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:32.024252 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-6410d71d-b245-4feb-a654-ce68cc4e8019 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:32.053250 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-6410d71d-b245-4feb-a654-ce68cc4e8019 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446540 Dec 24 04:52:32.063936 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Dec 24 04:52:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:52:34.451255 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:34.452786 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-381aecee-b32a-41b5-9075-e45752ea98ba None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Dec 24 04:52:34.453175 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:34.513680 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-95c0334a-adbb-4725-9100-45a8d26bb82c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "swap": 0, "vcpus": 1, "ram": 256, "name": "cirros256"}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:34.531895 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:52:34.531895 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: warnings.warn(msg) Dec 24 04:52:34.561669 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-95c0334a-adbb-4725-9100-45a8d26bb82c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101352 Dec 24 04:52:34.562466 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:34 2021] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 04:52:34.780355 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-0cc9d0e1-7396-479c-8b67-5af0efeb2009 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:34.782835 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:52:34.782835 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: warnings.warn(msg) Dec 24 04:52:34.833067 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-0cc9d0e1-7396-479c-8b67-5af0efeb2009 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262321 Dec 24 04:52:34.833864 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Dec 24 04:52:34 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:52:37.227134 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-95c0334a-adbb-4725-9100-45a8d26bb82c admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:37.228116 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-95c0334a-adbb-4725-9100-45a8d26bb82c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Dec 24 04:52:37.228768 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:37.368798 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-35aaea8e-02dd-4c5d-bf17-7ca155c3e288 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "name": "ds512M", "id": "d1", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:37.392844 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:52:37.392844 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: warnings.warn(msg) Dec 24 04:52:37.415634 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-35aaea8e-02dd-4c5d-bf17-7ca155c3e288 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.179747 Dec 24 04:52:37.423601 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 04:52:37.430124 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-f5862927-58be-4330-a611-1909687793d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:37.431905 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:52:37.431905 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: warnings.warn(msg) Dec 24 04:52:37.468484 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-f5862927-58be-4330-a611-1909687793d3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042817 Dec 24 04:52:37.469203 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Dec 24 04:52:37 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:52:39.923424 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-35aaea8e-02dd-4c5d-bf17-7ca155c3e288 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:39.924426 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-35aaea8e-02dd-4c5d-bf17-7ca155c3e288 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Dec 24 04:52:39.925072 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:39.992317 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-be9a77cf-0d91-481b-a26d-60739a89f598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "vcpus": 1}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:40.012393 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-be9a77cf-0d91-481b-a26d-60739a89f598 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081026 Dec 24 04:52:40.020578 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 04:52:40.025710 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-2065b4ec-f25d-46d5-a64f-4ada7e20ce2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:40.049257 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-2065b4ec-f25d-46d5-a64f-4ada7e20ce2f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027517 Dec 24 04:52:40.050152 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Dec 24 04:52:40 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:52:42.499177 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-be9a77cf-0d91-481b-a26d-60739a89f598 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:42.500294 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-be9a77cf-0d91-481b-a26d-60739a89f598 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Dec 24 04:52:42.500786 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:42.566261 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-c10c1701-fc1c-4bb6-b189-173eb8f1235b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds2G", "ram": 2048, "vcpus": 2}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:42.587278 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-c10c1701-fc1c-4bb6-b189-173eb8f1235b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079775 Dec 24 04:52:42.588171 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:52:42.602050 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-e24604b5-491b-46f1-b4ff-56da9ba74a96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:42.623985 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-e24604b5-491b-46f1-b4ff-56da9ba74a96 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026723 Dec 24 04:52:42.624816 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Dec 24 04:52:42 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:52:45.049023 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-c10c1701-fc1c-4bb6-b189-173eb8f1235b admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:45.050061 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-c10c1701-fc1c-4bb6-b189-173eb8f1235b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Dec 24 04:52:45.050410 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:45.113866 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-606a5eab-a045-4721-850b-70870e741d84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:45.135578 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-606a5eab-a045-4721-850b-70870e741d84 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077569 Dec 24 04:52:45.136382 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:52:45.149500 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-64a480d8-9428-451c-b344-86820971f292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:45.172974 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-64a480d8-9428-451c-b344-86820971f292 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027302 Dec 24 04:52:45.173544 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Dec 24 04:52:45 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:52:47.574403 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-606a5eab-a045-4721-850b-70870e741d84 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:47.575713 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-606a5eab-a045-4721-850b-70870e741d84 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Dec 24 04:52:47.576324 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:47.641507 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-2f2e8387-a80b-4def-b8ba-62fff1f94ca1 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:47.664962 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-2f2e8387-a80b-4def-b8ba-62fff1f94ca1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081699 Dec 24 04:52:47.665508 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Dec 24 04:52:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:52:50.104359 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-606a5eab-a045-4721-850b-70870e741d84 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:50.106640 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-606a5eab-a045-4721-850b-70870e741d84 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002563 Dec 24 04:52:50.107808 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:50 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:50.173671 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-7fb4a2d0-5ba9-4d3a-b302-0964158213c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:50.193667 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-7fb4a2d0-5ba9-4d3a-b302-0964158213c8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078660 Dec 24 04:52:50.194320 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:50 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:52:50.208018 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-41d8602c-fe75-4e75-b94c-5d5449950990 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:50.231357 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-41d8602c-fe75-4e75-b94c-5d5449950990 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026979 Dec 24 04:52:50.231930 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Dec 24 04:52:50 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:52:52.656128 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-7fb4a2d0-5ba9-4d3a-b302-0964158213c8 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:52.657185 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-7fb4a2d0-5ba9-4d3a-b302-0964158213c8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Dec 24 04:52:52.657552 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:52.718631 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-822f7444-b432-4134-a69f-9006515cf995 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:52.738492 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-822f7444-b432-4134-a69f-9006515cf995 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073978 Dec 24 04:52:52.739039 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:52:52.751419 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-b2d6e22f-d8b8-4ca5-b785-168cb129b82e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:52.773987 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-b2d6e22f-d8b8-4ca5-b785-168cb129b82e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026263 Dec 24 04:52:52.774771 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Dec 24 04:52:52 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:52:55.156159 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-822f7444-b432-4134-a69f-9006515cf995 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:55.157190 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-822f7444-b432-4134-a69f-9006515cf995 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Dec 24 04:52:55.157563 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:55.222861 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-ac0df671-9072-4863-871e-fdcea3bc073c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "m1.medium"}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:55.245943 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-ac0df671-9072-4863-871e-fdcea3bc073c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081041 Dec 24 04:52:55.246577 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:55 2021] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 04:52:55.259485 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-aa9f7d47-7d1c-4014-ac37-375390d61789 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:55.282414 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-aa9f7d47-7d1c-4014-ac37-375390d61789 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027120 Dec 24 04:52:55.283414 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Dec 24 04:52:55 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:52:57.758758 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-ac0df671-9072-4863-871e-fdcea3bc073c admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:52:57.759772 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-ac0df671-9072-4863-871e-fdcea3bc073c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Dec 24 04:52:57.760182 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:52:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:52:57.825635 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-510db36e-639c-43b6-8f50-b0dc452edfee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "ram": 8192}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:57.849773 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-510db36e-639c-43b6-8f50-b0dc452edfee admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082870 Dec 24 04:52:57.857361 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:52:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:52:57.862947 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-67f3feb8-ad22-48f3-bda0-dfb56c2a8d26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:52:57.890535 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-67f3feb8-ad22-48f3-bda0-dfb56c2a8d26 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031848 Dec 24 04:52:57.891150 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Dec 24 04:52:57 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:53:00.323345 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-510db36e-639c-43b6-8f50-b0dc452edfee admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:00.328705 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-510db36e-639c-43b6-8f50-b0dc452edfee admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005787 Dec 24 04:53:00.329111 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:53:00 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:00.388563 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-2a178085-0c04-4838-8f1d-29bbca3c5aa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "name": "m1.xlarge", "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:53:00.410528 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-2a178085-0c04-4838-8f1d-29bbca3c5aa7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074330 Dec 24 04:53:00.411370 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Dec 24 04:53:00 2021] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 04:53:00.428519 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-3922700e-d928-44b9-b1c3-f0d909181548 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:53:00.452926 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-3922700e-d928-44b9-b1c3-f0d909181548 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028873 Dec 24 04:53:00.453507 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Dec 24 04:53:00 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:53:21.412067 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-2a178085-0c04-4838-8f1d-29bbca3c5aa7 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:21.413633 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-2a178085-0c04-4838-8f1d-29bbca3c5aa7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Dec 24 04:53:21.414179 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:53:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:21.475315 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-55ef8448-be72-459d-9118-e6c4168040fa admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:21.492301 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-55ef8448-be72-459d-9118-e6c4168040fa admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071585 Dec 24 04:53:21.492869 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Dec 24 04:53:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:53:23.117055 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-2a178085-0c04-4838-8f1d-29bbca3c5aa7 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:23.118044 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-2a178085-0c04-4838-8f1d-29bbca3c5aa7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Dec 24 04:53:23.118466 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:23.331670 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-0bf00380-b239-4d6b-b89b-fff7dc2dcf71 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:23.340266 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.wsgi [None req-0bf00380-b239-4d6b-b89b-fff7dc2dcf71 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 24 04:53:23.341319 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-0bf00380-b239-4d6b-b89b-fff7dc2dcf71 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:53:23.342153 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-0bf00380-b239-4d6b-b89b-fff7dc2dcf71 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.085320 Dec 24 04:53:23.342686 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Dec 24 04:53:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:23.353137 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-32293b80-72c0-4a85-bae2-0b7f832829e9 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:23.373757 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-32293b80-72c0-4a85-bae2-0b7f832829e9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024131 Dec 24 04:53:23.374284 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Dec 24 04:53:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:53:23.384757 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-cbf022dd-bc1a-49d5-ab25-5159a0d0552d admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:23.406106 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-cbf022dd-bc1a-49d5-ab25-5159a0d0552d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024858 Dec 24 04:53:23.406651 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Dec 24 04:53:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:53:23.422735 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-a0c0bf63-362c-41c7-8069-26c1c654dab1 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:23.430319 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.wsgi [None req-a0c0bf63-362c-41c7-8069-26c1c654dab1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 24 04:53:23.430893 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-a0c0bf63-362c-41c7-8069-26c1c654dab1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:53:23.431690 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-a0c0bf63-362c-41c7-8069-26c1c654dab1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014573 Dec 24 04:53:23.432195 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Dec 24 04:53:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:24.923324 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-cbf022dd-bc1a-49d5-ab25-5159a0d0552d admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:24.924320 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-cbf022dd-bc1a-49d5-ab25-5159a0d0552d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Dec 24 04:53:24.924722 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:25.122007 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-1525bcfb-31f4-45c8-ad6f-63d6b0ca9560 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:25.128093 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.wsgi [None req-1525bcfb-31f4-45c8-ad6f-63d6b0ca9560 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 24 04:53:25.128694 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-1525bcfb-31f4-45c8-ad6f-63d6b0ca9560 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:53:25.129489 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-1525bcfb-31f4-45c8-ad6f-63d6b0ca9560 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067646 Dec 24 04:53:25.129979 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Dec 24 04:53:25 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:25.140196 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-22d83bdd-2474-4744-a445-e80f837bf78f admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:25.153815 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-22d83bdd-2474-4744-a445-e80f837bf78f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017469 Dec 24 04:53:25.154339 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Dec 24 04:53:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:53:25.164286 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-d7e8cd8e-ff81-408e-b3da-6e1e15132b33 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:25.177959 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-d7e8cd8e-ff81-408e-b3da-6e1e15132b33 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017110 Dec 24 04:53:25.178480 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Dec 24 04:53:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 04:53:25.188067 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-1be6cf8e-c617-48d5-a445-e1d670aa9518 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:25.193865 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.wsgi [None req-1be6cf8e-c617-48d5-a445-e1d670aa9518 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 24 04:53:25.194422 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-1be6cf8e-c617-48d5-a445-e1d670aa9518 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:53:25.195199 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-1be6cf8e-c617-48d5-a445-e1d670aa9518 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010633 Dec 24 04:53:25.195714 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Dec 24 04:53:25 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:26.672266 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-d7e8cd8e-ff81-408e-b3da-6e1e15132b33 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:26.673311 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-d7e8cd8e-ff81-408e-b3da-6e1e15132b33 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Dec 24 04:53:26.673718 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:26.877563 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-c05bf9e4-52f0-44e4-896f-cf0f6cb7152e admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:26.883003 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.wsgi [None req-c05bf9e4-52f0-44e4-896f-cf0f6cb7152e admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 24 04:53:26.883558 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-c05bf9e4-52f0-44e4-896f-cf0f6cb7152e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:53:26.884347 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-c05bf9e4-52f0-44e4-896f-cf0f6cb7152e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072493 Dec 24 04:53:26.884891 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Dec 24 04:53:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:26.894924 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-90263921-e8e5-487c-b6de-4c9e3bd92d2e admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:26.908440 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-90263921-e8e5-487c-b6de-4c9e3bd92d2e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017017 Dec 24 04:53:26.908993 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Dec 24 04:53:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:53:26.920740 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:26.934648 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019095 Dec 24 04:53:26.935181 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Dec 24 04:53:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:53:26.945105 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-89f0e4d6-2d45-492d-a1c7-d048706e2d8e admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:26.950446 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.wsgi [None req-89f0e4d6-2d45-492d-a1c7-d048706e2d8e admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 24 04:53:26.950990 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-89f0e4d6-2d45-492d-a1c7-d048706e2d8e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:53:26.951764 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-89f0e4d6-2d45-492d-a1c7-d048706e2d8e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010383 Dec 24 04:53:26.952240 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Dec 24 04:53:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 24 04:53:28.455004 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:28.455996 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 24 04:53:28.456387 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:28.650591 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-bca4c5b2-d105-46e8-b5f4-342c791f9a53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:53:28.674431 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-bca4c5b2-d105-46e8-b5f4-342c791f9a53 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076784 Dec 24 04:53:28.674974 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Dec 24 04:53:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:53:30.168706 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:30.169695 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Dec 24 04:53:30.170078 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:30.380714 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-20ce8339-ea9c-43a7-8101-81bd0a07f916 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:53:30.406696 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-20ce8339-ea9c-43a7-8101-81bd0a07f916 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.097618 Dec 24 04:53:30.407464 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Dec 24 04:53:30 2021] POST /compute/v2.1/flavors => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:53:31.888045 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:31.889091 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Dec 24 04:53:31.889484 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:32.087378 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-2a61badb-eb0a-42e9-b681-4ee119eaa23f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:53:32.112942 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-2a61badb-eb0a-42e9-b681-4ee119eaa23f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085161 Dec 24 04:53:32.113647 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Dec 24 04:53:32 2021] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:53:33.607754 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:33.609055 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Dec 24 04:53:33.609537 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:33.821914 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-5769ae25-f6d1-449a-85fc-4f29f5f0cc3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:53:33.843074 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-5769ae25-f6d1-449a-85fc-4f29f5f0cc3c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084001 Dec 24 04:53:33.843550 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Dec 24 04:53:33 2021] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:53:35.309480 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:35.310467 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Dec 24 04:53:35.310824 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:53:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:53:35.507070 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-0159e68f-9ea3-42d1-bee2-4049a1138450 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:53:35.526562 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-0159e68f-9ea3-42d1-bee2-4049a1138450 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078718 Dec 24 04:53:35.527032 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Fri Dec 24 04:53:35 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:54:23.685796 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:54:23.686774 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-bfede7c7-6d03-4e4f-b471-1b41e55c57e2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Dec 24 04:54:23.687165 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Fri Dec 24 04:54:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:54:23.757732 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-cd02f0db-3dd5-4c21-8b36-e1043fe14ebf admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:54:23.777290 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-cd02f0db-3dd5-4c21-8b36-e1043fe14ebf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083550 Dec 24 04:54:23.777824 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Dec 24 04:54:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:54:23.800558 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-22242aa0-f2b8-44be-aefe-e500a06d0226 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:54:23.810075 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-22242aa0-f2b8-44be-aefe-e500a06d0226 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013148 Dec 24 04:54:23.810739 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Fri Dec 24 04:54:23 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:54:23.824310 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-5f99f805-1b14-40cf-ba40-343fe04657ec admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:54:23.832561 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-5f99f805-1b14-40cf-ba40-343fe04657ec admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011627 Dec 24 04:54:23.833190 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Fri Dec 24 04:54:23 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:54:23.846519 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-07bae538-d7be-438d-b2e0-6ed2d057189d admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:54:23.854586 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-07bae538-d7be-438d-b2e0-6ed2d057189d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011698 Dec 24 04:54:23.855111 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Fri Dec 24 04:54:23 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:54:23.867162 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:54:23.875021 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011902 Dec 24 04:54:23.875543 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Fri Dec 24 04:54:23 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:55:48.239013 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-0f358700-4c35-44bf-bb87-b767e323ead9 tempest-verify_tempest_config-710930507 tempest-verify_tempest_config-710930507-project] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:55:48.241003 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-0f358700-4c35-44bf-bb87-b767e323ead9 tempest-verify_tempest_config-710930507 tempest-verify_tempest_config-710930507-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.133660 Dec 24 04:55:48.241528 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 34/69] 10.222.0.43 () {58 vars in 1133 bytes} [Fri Dec 24 04:55:48 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:57:13.998572 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:13.999900 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001936 Dec 24 04:57:14.000474 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:57:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:57:14.288968 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-7892c7b0-ef6c-4b31-809f-41a726f48a7c admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:14.290129 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:57:14.290129 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: warnings.warn(msg) Dec 24 04:57:14.291663 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-7892c7b0-ef6c-4b31-809f-41a726f48a7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:14.292087 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-7892c7b0-ef6c-4b31-809f-41a726f48a7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:14.292920 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-7892c7b0-ef6c-4b31-809f-41a726f48a7c admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:14.293392 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-7892c7b0-ef6c-4b31-809f-41a726f48a7c admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:14.327678 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-7892c7b0-ef6c-4b31-809f-41a726f48a7c admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.178385 Dec 24 04:57:14.328257 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 35/71] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Dec 24 04:57:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:57:15.856562 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:15.857646 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Dec 24 04:57:15.858013 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:57:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:57:16.067644 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-9f23fae0-581f-41a9-979c-9890b7cf5ff4 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:16.068812 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:57:16.068812 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: warnings.warn(msg) Dec 24 04:57:16.070307 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-9f23fae0-581f-41a9-979c-9890b7cf5ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:16.070719 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-9f23fae0-581f-41a9-979c-9890b7cf5ff4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:16.071525 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-9f23fae0-581f-41a9-979c-9890b7cf5ff4 admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:16.071936 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-9f23fae0-581f-41a9-979c-9890b7cf5ff4 admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:16.090766 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-9f23fae0-581f-41a9-979c-9890b7cf5ff4 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.092544 Dec 24 04:57:16.091300 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 36/73] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Dec 24 04:57:15 2021] GET /compute/v2.1/os-services => generated 791 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 04:57:28.039580 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:28.040575 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Dec 24 04:57:28.041010 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 38/74] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:57:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:57:28.248698 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-d6fb1ee8-e7cf-478d-b271-270bbb10739b admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:28.249844 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:57:28.249844 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: warnings.warn(msg) Dec 24 04:57:28.251321 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-d6fb1ee8-e7cf-478d-b271-270bbb10739b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:28.251761 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-d6fb1ee8-e7cf-478d-b271-270bbb10739b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:28.252569 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-d6fb1ee8-e7cf-478d-b271-270bbb10739b admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:28.252972 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-d6fb1ee8-e7cf-478d-b271-270bbb10739b admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:28.276490 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-d6fb1ee8-e7cf-478d-b271-270bbb10739b admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093002 Dec 24 04:57:28.277061 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 37/75] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Dec 24 04:57:28 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:57:29.819414 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: DEBUG nova.api.openstack.wsgi [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] Calling method '>' {{(pid=101739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:29.820653 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: INFO nova.api.openstack.requestlog [None req-802e61e6-97cb-4c01-bffb-87225f8b8e07 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Dec 24 04:57:29.821174 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: [pid: 101739|app: 0|req: 39/76] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Dec 24 04:57:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:57:30.032694 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG nova.api.openstack.wsgi [None req-5f0a9267-303b-46ff-aa27-84ce999df7e0 admin admin] Calling method '>' {{(pid=101738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:57:30.033881 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:57:30.033881 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: warnings.warn(msg) Dec 24 04:57:30.035386 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-5f0a9267-303b-46ff-aa27-84ce999df7e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:30.035818 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-5f0a9267-303b-46ff-aa27-84ce999df7e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:30.036659 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-5f0a9267-303b-46ff-aa27-84ce999df7e0 admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:57:30.037079 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: DEBUG oslo_concurrency.lockutils [None req-5f0a9267-303b-46ff-aa27-84ce999df7e0 admin admin] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:57:30.058471 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: INFO nova.api.openstack.requestlog [None req-5f0a9267-303b-46ff-aa27-84ce999df7e0 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090428 Dec 24 04:57:30.059003 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: [pid: 101738|app: 0|req: 38/77] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Dec 24 04:57:29 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:58:27.194108 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: Fri Dec 24 04:58:27 2021 - graceful shutdown triggered... Dec 24 04:58:27.194220 dv-cinder-816443-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 24 04:58:27.195308 dv-cinder-816443-2-iscsi devstack@n-api.service[101739]: Gracefully killing worker 2 (pid: 101739)... Dec 24 04:58:27.195770 dv-cinder-816443-2-iscsi devstack@n-api.service[101738]: Gracefully killing worker 1 (pid: 101738)... Dec 24 04:58:28.196661 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: worker 1 buried after 1 seconds Dec 24 04:58:28.196661 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: worker 2 buried after 1 seconds Dec 24 04:58:28.196661 dv-cinder-816443-2-iscsi devstack@n-api.service[101737]: goodbye to uWSGI. Dec 24 04:58:28.199041 dv-cinder-816443-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 24 04:58:28.199920 dv-cinder-816443-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 24 04:58:28.204373 dv-cinder-816443-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 24 04:58:28.216930 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Dec 24 04:58:28 2021] *** Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: nodename: dv-cinder-816443-2-iscsi Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: machine: x86_64 Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: clock source: unix Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: pcre jit disabled Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: detected number of CPU cores: 4 Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: current working directory: / Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: detected binary path: /usr/bin/uwsgi-core Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: your processes number limit is 47680 Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: your memory page size is 4096 bytes Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: detected max file descriptor number: 2048 Dec 24 04:58:28.218848 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: lock engine: pthread robust mutexes Dec 24 04:58:28.219766 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: thunder lock: enabled Dec 24 04:58:28.219766 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 24 04:58:28.219766 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 24 04:58:28.264948 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: Python main interpreter initialized at 0x560449b6f9c0 Dec 24 04:58:28.264948 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: python threads support enabled Dec 24 04:58:28.264948 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: your server socket listen backlog is limited to 100 connections Dec 24 04:58:28.264948 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: your mercy for graceful operations on workers is 90 seconds Dec 24 04:58:28.265398 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: mapped 403077 bytes (393 KB) for 2 cores Dec 24 04:58:28.265398 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: *** Operational MODE: preforking *** Dec 24 04:58:28.265663 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: *** uWSGI is running in multiple interpreter mode *** Dec 24 04:58:28.265663 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: spawned uWSGI master process (pid: 116316) Dec 24 04:58:28.265875 dv-cinder-816443-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 24 04:58:28.266473 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: spawned uWSGI worker 1 (pid: 116329, cores: 1) Dec 24 04:58:28.266824 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: spawned uWSGI worker 2 (pid: 116330, cores: 1) Dec 24 04:58:28.267126 dv-cinder-816443-2-iscsi devstack@n-api.service[116316]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 24 04:58:30.146143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:58:30.146143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: from cryptography.utils import int_from_bytes Dec 24 04:58:30.146858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:58:30.146858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: from cryptography.utils import int_from_bytes Dec 24 04:58:30.200253 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:58:30.200253 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: from cryptography.utils import int_from_bytes Dec 24 04:58:30.200995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:58:30.200995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: from cryptography.utils import int_from_bytes Dec 24 04:58:32.526370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:58:32.526962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:58:32.527060 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:58:32.527393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:58:32.527647 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:58:32.528048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.528390 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.528734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.529050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.529359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.529667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.530888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.530888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.530888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.530888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.532156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.532156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-2-iscsi {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.532156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.532156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.532477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.532830 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.533198 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.533524 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.534262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.534359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.535093 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.535320 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.535718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.536083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.536377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.536848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.537043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.537355 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.537671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.538053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.538383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-2-iscsi {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.538697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.539001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.539329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.539743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.540056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.540361 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.540715 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.541041 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.541345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.541671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.541989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.542305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.542622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.542921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.543226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.543520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.543835 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.544140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.544440 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.544718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.545024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.545345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.545662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.545984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.546233 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.546479 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.546795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.547111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.547416 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.547723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.548024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.548454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.548762 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.549066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.549370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.549676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.549992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.550306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.550625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.550931 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.551248 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.551642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.551892 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.552196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.552552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.552871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.553180 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.553497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.553815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.554135 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.554442 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.554747 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.555214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.555386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.556318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.556318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.556318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.556569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.556858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.557165 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.557470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.557771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.558069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.558377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.558682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.558985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.559323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.559622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.559954 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.560200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.560693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.560872 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.561166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.561454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.561781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.562083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.562385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.562689 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.563004 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.563289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.563592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.563910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.564587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.564587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.564963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.565274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.565582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.565896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.566425 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.566557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.566803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.567108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.567409 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.567712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.568066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.568322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.568717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.569021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.569320 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.569608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.569921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.570239 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.570548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.570851 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.571153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.571470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.571811 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.572142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.572484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.572824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.573159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.573488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.573806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.574120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.574431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.574756 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.575068 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.575381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.575690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.576009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.576462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.576776 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.576980 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.577302 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.577618 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.577932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.578257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.578585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.578910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.579223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.579564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.580431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.580431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.580802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.581118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.581443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.581757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.582071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.582384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.582726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.583039 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.583351 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.583687 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.584005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.584319 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.584965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.585274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.585579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.585890 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.586194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.586576 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.586836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.587132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.587468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.587771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.588086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.588403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.588721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.589052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.589340 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.589642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.589963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.590274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.590575 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.590896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.591199 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.591502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.591815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.592124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.592433 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.592769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.593091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.593401 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.593710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.594041 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.594371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.594675 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.594998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.595391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.596051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.596051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.596318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.596749 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.596915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.597187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.597495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.597798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.598108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.598410 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.598711 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.599536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:58:32.600011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.600125 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:58:32.600260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.600260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.600638 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:58:32.600754 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.600911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:58:32.601064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.601201 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:58:32.601327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.601461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.601596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.601720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.601856 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.601986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.602108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.602223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.602338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.602453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.602580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.602697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.602813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.602813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.603013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.603121 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.603242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.603351 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.603465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.603583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.603702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.603859 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.603978 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.604169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.604294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816443-2-iscsi {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.604491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.604642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.604828 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.604948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.605147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.605281 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.605463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.605583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.605800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.605987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.606109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.606221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.606413 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.606592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.606954 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.607094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.607348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.607472 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.607582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.607704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.607822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.607939 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.608048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.608162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.608283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.608477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.608700 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.608852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.608994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.609124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.609259 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.609395 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.609536 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.609745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.609877 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.610004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.610143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.610376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.610672 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816443-2-iscsi {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.610827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.611138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.611717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.611909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.612056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.612194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.612323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.612457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.612667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.612797 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.612921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.613045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.613169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.613299 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.613438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.613574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.613709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.613834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.613967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.614098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.614231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.614364 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.614501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.614628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.614760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.614893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.615026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.615153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.615278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.615402 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.615535 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.615662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.615795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.615927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.616052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.616176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.616309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.616441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.616605 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.616742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.616883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.617212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.617368 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.617582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.617726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.617726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.617976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.618113 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.618239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.618239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.618502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.618634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.618760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.618884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.619008 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.619140 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.619267 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.619391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.619521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.619646 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.619875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.620012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.620147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.620273 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.620397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.620510 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.620690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.620903 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.621025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.621135 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.621254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.621454 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.621647 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.621771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.621892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.622012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.622121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.622379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.622581 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.622709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.622820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.622936 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.623056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.623274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.623452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.623582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.623694 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.623886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.624065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.624197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.624359 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.624475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.624643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.624884 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.625054 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.625207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.625343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.625469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.625593 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.625745 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.625870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.626003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.626138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.626269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.626384 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.626703 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.626833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.626955 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.627305 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.627681 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.627921 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.628078 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.628234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.628388 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.628546 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.628744 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.628891 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.629033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.629192 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.629338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.629490 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.629633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.630023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.630023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.630369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.630507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.630631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.630962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.631091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.631209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.631333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.631452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.631574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.631693 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.631809 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.631933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.632046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.632161 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.632270 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.632377 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.632493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.632764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.632910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.633051 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.633197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.633377 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.633615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.633767 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.633917 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.634057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.634197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.634348 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.634498 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.634648 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.634788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.634927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.635074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.635074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.635364 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.635513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.635661 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.635811 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.635952 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.636102 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.636246 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.636384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.636549 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.636714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.636864 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.637012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.637161 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.637518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.637677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.637929 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.638086 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.638228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.638388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.638545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.638687 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.638832 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.638972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.639110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.639277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.639516 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.639684 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.639836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.640003 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.640225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.640380 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.640611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.640771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.640915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.641077 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.641317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.641471 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.641611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.641752 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.641898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.642048 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.642295 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.642453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.642602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.642756 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.642897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.643037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.643189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.643330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.643469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.643618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.643766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.643766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.644057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.644199 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.644337 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:58:32.644486 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.644659 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.644845 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.644999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.645141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.645141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.645421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.645561 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.645711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.645852 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.645990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.646131 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.646277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.646438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.646579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.646725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.646872 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.647013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.647161 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.647315 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.647660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.647816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.647984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.648224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.648377 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.648563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.648734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.648877 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.649016 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.649163 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.649163 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.649445 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.649586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.649743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.649884 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.650022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.650170 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.650400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.650565 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.650714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.650856 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.650995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.651143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.651310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.651540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.651692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.651848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.652004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.652159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.652307 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.652449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.652449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.652769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.652918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.653074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.653215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.653354 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.653493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.653640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.653794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.653943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.654090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.654231 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.654370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.654520 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.654673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.654814 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.654953 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.655091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.655230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.655377 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.655526 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.655666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.655812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.655812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.656084 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.656230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.656427 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.656589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.656733 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.656872 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.657022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.657176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.657324 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.657472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.657904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.658055 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.658212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.658457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.658620 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.658770 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.658911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659191 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659489 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.659911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.660197 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.660338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.660617 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.660769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.660942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.661167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.661320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.661470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.661725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.661881 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.662041 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.662195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.662344 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.662485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.662632 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.662784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.662933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.663087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.663229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.663369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.663507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.663657 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.663797 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.663952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.664092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.664239 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.664380 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.664519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.664696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.664853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.664995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.665142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.665290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.665430 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.665583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.668490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.668906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.669066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.669217 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.669371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.669539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.669685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.669685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.669964 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.670103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.670244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.670396 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.670564 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.670799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.670989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.671146 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.671289 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.671443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.671595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.671754 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.672002 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.672147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.672302 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.672445 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.672604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.672759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.672908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.673050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.673202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.673344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.673915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.674080 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.674221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.674363 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.674585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.674736 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.674884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.675025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.675165 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.675313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.675463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.675612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.675791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.676020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.676267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.676515 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.676823 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.676978 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.677121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.677270 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.677411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.677562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.677711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.677854 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.678024 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.678262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.678262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.678262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.679207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.679391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.679580 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.679733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.679875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.680088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.680088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.680543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.680804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.680804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.680804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.681652 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.681800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.681941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.682203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.682358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.682510 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.682667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.682810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.682956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683097 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683399 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.683967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.684241 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.684390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.684390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.684705 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.684858 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.684858 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.685133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.685282 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.685429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.685587 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.685737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.685893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.686034 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.686181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.686392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.686543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.686683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.686836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.686836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.687119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.687259 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.687259 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.687542 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.687695 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.687836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.687977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.688124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.688271 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.688464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.688642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.689464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.689618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.689761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.689947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.690115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.690265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.690408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.690555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.690696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.690844 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.690993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.691228 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.691374 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.691515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.691663 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.691813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.691966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.692195 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.692357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.692645 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.692802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.692996 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.693144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.693285 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.693432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.693572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.693572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.693858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.693998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.694137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.694295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.694435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.694574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.694734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.694875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.695015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.695154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.695293 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.695441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.695660 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.695802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.695950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.696102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.696242 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.696391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.696552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.696697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.696848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.696996 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.697145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.697362 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.697507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.697654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.697794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.697941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.698101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.698256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.698398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.698537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.698676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.698815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.698961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.699433 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.699588 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.699736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.699878 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.700017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.700158 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.700321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.700471 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.700690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.700832 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.700972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.701125 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.701358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.701514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.701657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.701798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.701945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.702095 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.702243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.702395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.702546 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.702868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.703023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.703178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.703320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.703460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.703599 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.703740 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.703888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.704030 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.704177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.704337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.704485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.704785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.704952 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.705096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.705236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.705384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.705524 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.705664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.705664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.705941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.706081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.706231 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.706382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.706524 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.706673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.706821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.706963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.707110 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.707258 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.707411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.707559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.707708 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.707855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.708005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.708153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.708312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.708462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.708649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.708792 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.708792 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.709076 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.709250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.710057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.710216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.710359 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.710506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.710654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.710806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.710958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.711101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.711249 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.711488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.711643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.711786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.711933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.712075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.712223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.712364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.712364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.712364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.712819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.713065 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.713211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.713364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.713519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.713668 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.713817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.713966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.714105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.714247 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.714395 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.714544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.714692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.714843 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.714983 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.715130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.715281 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.715431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.715572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.715572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.715847 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.715995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.716136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.716276 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.716418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.716592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.716759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.716902 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.717048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.717196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.717338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.717490 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.717646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.717787 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.717926 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.718066 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.718216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.718363 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.718505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.718653 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.718800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.718949 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.719098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.719246 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.719387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.719628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.719845 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.720087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.720351 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.720351 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.720700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.720853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.720992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.721149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.721301 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.721443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.721676 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.721822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.722001 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.722001 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.722283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.722283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.722612 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.722764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.722918 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.723077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.723309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.723465 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.723613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.723755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.723977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.724129 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.724277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.724426 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.724594 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.724753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.724903 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.725081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.725238 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.725386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.725541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.725541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.725841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.725995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.726142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.726295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.726450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.726610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.726777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.726925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.727071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.727219 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.727372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.727528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.727684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.727839 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.728138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.728305 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.728305 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.728671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.728822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.728979 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.729126 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.729271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.729425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.729605 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.729838 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.730072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.730307 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.730661 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.730915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.731083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.731232 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.731400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.731548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.731722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.731941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732260 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.732974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733058 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733149 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733233 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733337 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733494 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733651 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733870 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733948 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.733948 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734531 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734601 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734885 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.734956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735024 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735242 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735699 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.735928 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736040 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736114 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736202 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736281 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736352 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736438 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736873 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.736953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737165 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737473 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737543 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737835 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.737989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.738060 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.738141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.738285 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.738366 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.738613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.738692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.738934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.739022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.739239 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.739318 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.739564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.739674 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.739866 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.739978 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.740164 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.740292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.740468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.740704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.740809 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.740968 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.741848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.742094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.742257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.742415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.742564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.742724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.742872 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.743942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.744239 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.744401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.744662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.744819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.744974 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.745131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.745278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.745433 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.745433 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.745724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.745871 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.746025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.746025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.746321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.746469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.746621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.746873 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.747035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.747208 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.747365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.747513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.747667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.747815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.747961 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.748116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.748263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.748418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.748595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.748755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.748911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.749088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.749244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.749393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.749540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.749686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.749842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.750076 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.750251 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.750475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.750738 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.750985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.751223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.751394 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.751590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.751743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.751898 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.752073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.752304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.752457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.752627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.752788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.752935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.753094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.753094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.753463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.753622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.753622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.753926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.754085 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.754232 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.754387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.754387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.754677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.754845 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.755002 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.755152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.755313 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.755460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.755616 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.755762 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.755922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.756077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.756232 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.756382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.756597 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.756765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.757030 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.757219 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.757370 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.757525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.757680 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.757849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.757997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.758161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.758319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.758467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.758623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.758781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.758942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.759091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.759091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.759369 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.759532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.759698 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.759847 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.760005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.760251 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.760414 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.760694 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.760926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.761181 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.761343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.761493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.761647 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.761820 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.761970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.762130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.762295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.762516 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.762678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.762827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.762980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.763130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.763286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.763434 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.763597 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.763747 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.763903 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.764059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.764225 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.764375 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.764591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.764759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.764906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.765054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.765200 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.765347 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.765508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.765659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.765815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.765963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.766131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.766294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.766442 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.766590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.766737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.766893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.767087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.767558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.767748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.767961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.768148 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.768307 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.768456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.768656 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.768817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.768967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.769113 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.769260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.769407 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.769568 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.769568 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.769851 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.770006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.770162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.770406 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.770582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.770821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.771060 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.771060 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.771450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.771614 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.771777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.771937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.772092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.772251 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.772399 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.772656 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.772813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.772987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.773141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.773297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.773458 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.773614 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.773810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.773963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.774119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.774274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.774436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.774584 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.774731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.774878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.775417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.776579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.776579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.776579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.776579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.776579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.776579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.777465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.777465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.777465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.778000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.778000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.778283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.778584 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.778892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.779218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.779529 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.779855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.780171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.780485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.780853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.781127 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.781523 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.781780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.782121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.782444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.782832 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.783170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.783610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.783947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.784274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.784750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.784941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.785263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.785589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.785909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.786229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.786549 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.786870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.787191 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.787515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.788399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.788399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.788764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.789057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.789376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.790121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.791269 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.791867 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.792374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.792817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.793082 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.793431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.793776 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.794119 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.794466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.794932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.795136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.795419 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.795743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.795932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:32.796101 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.796426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.796779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.798739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.798739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.798739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.798739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.798739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.799514 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.799514 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.799871 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.800061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.801999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.801999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.801999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.801999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.801999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.802668 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.802668 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.802881 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.803354 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.803675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.804080 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.804417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.804773 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.805105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.805431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.805768 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.806082 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.806395 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.806716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.807036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.807350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.807680 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.808000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.808310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.808664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.808984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.809524 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.809880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.810206 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.810545 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.810878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.811201 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.811515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.811848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.812165 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.812475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.812824 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.813222 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.813452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.813764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.814220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.814541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.814855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.815175 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.815482 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.815819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.816132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.816443 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.816796 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.817115 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.817425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.817732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.818044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.818404 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.818675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.818985 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.819300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.819610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.819926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.820236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.820579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.820897 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.821226 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.821538 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.821861 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.822170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.822480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.822810 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.823131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.823449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.823809 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.824133 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.824702 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.825141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.825475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.825874 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.826988 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.827310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.827626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.827941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.828272 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.828620 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.828945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.829263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.829616 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.831199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.831542 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.831876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.832216 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.832714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.832900 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.833260 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.833598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.833992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.834324 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.834973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.835297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.835621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.835947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.836270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.836623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.836967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.837297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.837612 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.838052 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.838375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.838706 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.839036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.839357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.839690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.840024 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.840349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.840707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.841029 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.841367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.841720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.842057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.842390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.842705 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.843017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.843330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.843651 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.843992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.844335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.844682 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.845015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.845428 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.845799 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.846123 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.846455 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.846785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.847111 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.847431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.847771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.848091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.848411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.848788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.849111 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.849435 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.849753 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.850087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.850428 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.850744 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.851078 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.851404 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.851765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.852090 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.852409 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.852746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.853068 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.853393 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.853715 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.854037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.854361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.854689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.855024 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.855358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.855695 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.856026 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.856383 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.856727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.857085 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.857421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.857750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.858071 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.858382 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:58:32.858628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:58:32.867927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.context [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9562cd56-697c-4a0e-b853-980571393783(cell1) {{(pid=116330) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 04:58:32.872246 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:58:32.873882 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:58:32.874712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:58:32.876780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:58:32.881393 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_db.sqlalchemy.engines [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:32.889410 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:32.890244 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:32.947655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.context [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9562cd56-697c-4a0e-b853-980571393783(cell1) {{(pid=116329) load_cells /opt/stack/nova/nova/context.py:464}} Dec 24 04:58:32.952044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:58:32.953792 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:58:32.954704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:58:32.956851 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:58:32.969826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_db.sqlalchemy.engines [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:32.971142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_db.sqlalchemy.engines [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:33.050514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_db.sqlalchemy.engines [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:33.133062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_db.sqlalchemy.engines [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:58:33.367856 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:58:33.374613 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:58:33.461452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: WARNING keystonemiddleware.auth_token [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:58:33.468436 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: WARNING keystonemiddleware.auth_token [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:58:33.714780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:58:33.720118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: WARNING keystonemiddleware.auth_token [None req-6c04a585-691f-492c-a600-bcae647ad55b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:58:33.726229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560449b6f9c0 pid: 116330 (default app) Dec 24 04:58:33.810493 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: WARNING keystonemiddleware.auth_token [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:58:33.815823 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: WARNING keystonemiddleware.auth_token [None req-ea6e3125-4a89-429b-8bce-0b04040d65a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:58:33.821218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560449b6f9c0 pid: 116329 (default app) Dec 24 04:59:07.852856 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0afc5bcd-83c3-48b1-8888-bd926560fa48 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Action: 'create', calling method: .version_select at 0x7f7bafe93ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1321055497", "metadata": {"Type": "work"}}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:08.451596 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9ce62eba-edde-4a57-ba28-0d044dde05b7 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Action: 'create', calling method: .version_select at 0x7f7bafea4e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-826665443", "metadata": {"Type": "work"}}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:08.451596 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9ce62eba-edde-4a57-ba28-0d044dde05b7 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:59:08.451596 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9ce62eba-edde-4a57-ba28-0d044dde05b7 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.246146 Dec 24 04:59:08.456330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Dec 24 04:59:07 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 24 04:59:08.476511 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ed9c7602-e198-4740-aad3-716f542d8ca8 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Action: 'create', calling method: .version_select at 0x7f7bafdd99d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2075702501", "metadata": {"Type": "work"}}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:08.480830 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ed9c7602-e198-4740-aad3-716f542d8ca8 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:59:08.481660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ed9c7602-e198-4740-aad3-716f542d8ca8 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016892 Dec 24 04:59:08.484842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Dec 24 04:59:08 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 24 04:59:08.495148 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f62ce453-2a5b-4c86-9a5c-8708fd5c0afd tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Action: 'create', calling method: .version_select at 0x7f7bafdd9940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-921442533", "metadata": {"Type": "work"}}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:08.500183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f62ce453-2a5b-4c86-9a5c-8708fd5c0afd tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:59:08.503423 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f62ce453-2a5b-4c86-9a5c-8708fd5c0afd tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013556 Dec 24 04:59:08.505437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 3/3] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Dec 24 04:59:08 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 24 04:59:08.514703 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-405e6b34-c785-4652-8f64-ae1cf549b006 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Calling method '.version_select at 0x7f7bafe324c0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:09.019468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-405e6b34-c785-4652-8f64-ae1cf549b006 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] HTTP exception thrown: Volume tempest-invalid-1198224428 could not be found. Dec 24 04:59:09.023109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-405e6b34-c785-4652-8f64-ae1cf549b006 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Returning 404 to user: Volume tempest-invalid-1198224428 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:59:09.025531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-405e6b34-c785-4652-8f64-ae1cf549b006 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1198224428" status: 404 len: 99 microversion: 2.1 time: 0.513558 Dec 24 04:59:09.026855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 4/4] 10.222.0.43 () {58 vars in 1217 bytes} [Fri Dec 24 04:59:08 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1198224428 => generated 99 bytes in 516 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 24 04:59:09.038328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5440bdee-746d-47aa-ae55-314a268a42c4 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004352 Dec 24 04:59:09.039638 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 5/5] 10.222.0.43 () {58 vars in 1139 bytes} [Fri Dec 24 04:59:09 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 24 04:59:09.055504 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-86b969bf-9e49-474c-8e14-fb7be33273bd tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010000 Dec 24 04:59:09.063147 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 6/6] 10.222.0.43 () {58 vars in 1136 bytes} [Fri Dec 24 04:59:09 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 24 04:59:09.083693 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a866efef-7715-4534-9df6-65ab1f78971b tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Calling method '.version_select at 0x7f7bafd83ee0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:09.154333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0afc5bcd-83c3-48b1-8888-bd926560fa48 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.549857 Dec 24 04:59:09.156222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 1/7] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Dec 24 04:59:06 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2554 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 24 04:59:09.171374 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-368e4a84-1955-4d09-8c4c-648ea9e204e2 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7bafd79a60>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:09.233268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-a866efef-7715-4534-9df6-65ab1f78971b tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] HTTP exception thrown: Volume 642696f2-ff20-4035-b821-2daad4f0e8dd could not be found. Dec 24 04:59:09.234148 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a866efef-7715-4534-9df6-65ab1f78971b tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Returning 404 to user: Volume 642696f2-ff20-4035-b821-2daad4f0e8dd could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:59:09.235247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a866efef-7715-4534-9df6-65ab1f78971b tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/642696f2-ff20-4035-b821-2daad4f0e8dd" status: 404 len: 109 microversion: 2.1 time: 0.167771 Dec 24 04:59:09.236734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 7/8] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Dec 24 04:59:09 2021] DELETE /compute/v2.1/os-volumes/642696f2-ff20-4035-b821-2daad4f0e8dd => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 04:59:09.250366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3274e422-18bc-4d35-8f15-afb7f0981a57 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Calling method '.version_select at 0x7f7bafd83a60>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:09.325075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-368e4a84-1955-4d09-8c4c-648ea9e204e2 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 353 microversion: 2.1 time: 0.160468 Dec 24 04:59:09.326701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 2/9] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:09 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:09.378909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-3274e422-18bc-4d35-8f15-afb7f0981a57 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] HTTP exception thrown: Volume bca744e2-577c-4626-976b-a98d89bed235 could not be found. Dec 24 04:59:09.380871 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3274e422-18bc-4d35-8f15-afb7f0981a57 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] Returning 404 to user: Volume bca744e2-577c-4626-976b-a98d89bed235 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:59:09.382664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3274e422-18bc-4d35-8f15-afb7f0981a57 tempest-VolumesNegativeTest-2081295667 tempest-VolumesNegativeTest-2081295667-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bca744e2-577c-4626-976b-a98d89bed235" status: 404 len: 109 microversion: 2.1 time: 0.136418 Dec 24 04:59:09.384304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 8/10] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:09 2021] GET /compute/v2.1/os-volumes/bca744e2-577c-4626-976b-a98d89bed235 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 04:59:10.340124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8a598b20-3005-4c68-8bdd-69348d4e9a23 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7bafd1bee0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:10.443682 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8a598b20-3005-4c68-8bdd-69348d4e9a23 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 353 microversion: 2.1 time: 0.108895 Dec 24 04:59:10.444706 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 9/11] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:10 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:10.506024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-626842251", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "598b6cd9-9673-4e27-b33e-451cd98b5f1c"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:10.695301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] validate_networks() for [('598b6cd9-9673-4e27-b33e-451cd98b5f1c', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 04:59:11.651073 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1441452230", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "b92a87f3-957a-4ccb-9b5b-98ad92aebe6e"}]}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:11.828170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] validate_networks() for [('b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 04:59:12.660675 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 04:59:12.661203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 04:59:12.661538 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 04:59:12.661933 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 04:59:12.662378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 04:59:12.689795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:12.691359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:12.693255 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:12.694616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:12.753138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Getting quotas for project 14dbe9b1ff9041858e25c4fafebc1a51. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:12.764960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Getting quotas for user 61664b664e1d45e686290d000f94f5ab and project 14dbe9b1ff9041858e25c4fafebc1a51. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:12.784432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 04:59:12.789217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 04:59:12.923335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75dea018-2e13-4310-9906-f2f2fba97f61 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.673020 Dec 24 04:59:12.924136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 3/12] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 04:59:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 2675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 24 04:59:12.933240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4c6abf59-8915-4539-97eb-318f34d37bd4 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baf410310>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:13.099094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4c6abf59-8915-4539-97eb-318f34d37bd4 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 354 microversion: 2.1 time: 0.173577 Dec 24 04:59:13.099718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 4/13] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:12 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:13.113373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6429bf9b-47e0-4aeb-8e74-a88f292f28bf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:13.114514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6429bf9b-47e0-4aeb-8e74-a88f292f28bf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:13.411192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6429bf9b-47e0-4aeb-8e74-a88f292f28bf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:13.434571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6429bf9b-47e0-4aeb-8e74-a88f292f28bf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1214 microversion: 2.1 time: 0.326578 Dec 24 04:59:13.441996 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 5/14] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:13 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1214 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:13.450934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-12792b27-df1d-4098-bda4-0a849e6a6260 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baf42dca0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:13.503685 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 04:59:13.504230 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 04:59:13.504843 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 04:59:13.505329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 04:59:13.505820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 04:59:13.538923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:13.541777 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:13.543558 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:13.545809 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:13.568094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-12792b27-df1d-4098-bda4-0a849e6a6260 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 354 microversion: 2.1 time: 0.124655 Dec 24 04:59:13.577224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 6/15] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:13 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:13.582931 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d75ea2fe-fbd4-4f85-99e5-9e2099c15be3 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baf434e50>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:13.663707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:13.682338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for user f29f576d3a98449b8077c0df53968f07 and project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:13.737450 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 04:59:13.747595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 04:59:13.760810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d75ea2fe-fbd4-4f85-99e5-9e2099c15be3 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 202 len: 0 microversion: 2.1 time: 0.182142 Dec 24 04:59:13.761431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 7/16] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Dec 24 04:59:13 2021] DELETE /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 04:59:13.776215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1b234fe8-f68d-456d-9369-797bf23bc2e2 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baf434f70>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:13.902932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-091448e8-cf3a-40c8-90df-a8a764d79f38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.651463 Dec 24 04:59:13.903572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 10/17] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 04:59:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 2654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 04:59:13.917418 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-97a51388-377d-42a8-aa42-193a88f71a64 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:13.919723 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-97a51388-377d-42a8-aa42-193a88f71a64 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:13.991719 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1b234fe8-f68d-456d-9369-797bf23bc2e2 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 353 microversion: 2.1 time: 0.223845 Dec 24 04:59:14.001486 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 8/18] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:13 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:14.361286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-97a51388-377d-42a8-aa42-193a88f71a64 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:14.425769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-97a51388-377d-42a8-aa42-193a88f71a64 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1218 microversion: 2.1 time: 0.511056 Dec 24 04:59:14.441381 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 11/19] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:13 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1218 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:14.463072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1328bffc-fa77-4b38-8c78-492ff2e66d99 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:14.467586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1328bffc-fa77-4b38-8c78-492ff2e66d99 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:14.811338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1328bffc-fa77-4b38-8c78-492ff2e66d99 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:14.838882 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1328bffc-fa77-4b38-8c78-492ff2e66d99 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1214 microversion: 2.1 time: 0.384555 Dec 24 04:59:14.844230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 9/20] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:14 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1214 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:15.010802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-dc08d473-6496-49a4-84c9-a60aedcfb1b7 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baf410790>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:15.131143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-dc08d473-6496-49a4-84c9-a60aedcfb1b7 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 353 microversion: 2.1 time: 0.128660 Dec 24 04:59:15.131717 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 12/21] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:15 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:15.447680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:15.449492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:15.462350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:15.462821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:15.463635 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:15.464059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:15.662607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:15.680988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-872302a7-9524-48ae-92ae-4ba41b208ed7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1222 microversion: 2.1 time: 0.238195 Dec 24 04:59:15.682751 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 10/22] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:15 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1222 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:15.860544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:15.861697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:15.871619 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:15.872168 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:15.873207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:15.873848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:16.143458 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aae1919f-e197-4d15-abad-e060a894ab63 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baebc6670>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:16.233337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aae1919f-e197-4d15-abad-e060a894ab63 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 353 microversion: 2.1 time: 0.093993 Dec 24 04:59:16.233918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:16 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:16.273826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:16.327470 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-745cbba2-75f8-4d93-af52-82582123af3d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1218 microversion: 2.1 time: 0.470694 Dec 24 04:59:16.328466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 13/24] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:15 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1218 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:16.698487 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:16.699093 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:16.710661 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:16.716717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:16.717764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:16.718301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:16.847634 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:16.860678 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1222 microversion: 2.1 time: 0.160657 Dec 24 04:59:16.863544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:16 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:17.246492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e9db2af4-4a22-4bda-be26-94ac2e89b54b tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baebc61f0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:17.352308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e9db2af4-4a22-4bda-be26-94ac2e89b54b tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 200 len: 353 microversion: 2.1 time: 0.109530 Dec 24 04:59:17.352906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 13/26] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:17 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:17.362054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:17.362672 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:17.378220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:17.378586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:17.379382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:17.379814 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:17.451952 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6f873dea-8d11-453d-a00a-ab2df467387d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'create', calling method: .version_select at 0x7f7baeb52310>, body: {"keypair": {"name": "tempest-keypair-1111329987"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:17.490181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-6f873dea-8d11-453d-a00a-ab2df467387d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:17.504371 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-6f873dea-8d11-453d-a00a-ab2df467387d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for user 979cc4a0723b4543a16197d393c7929a and project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:17.556451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:17.564116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-58c1de7b-18cd-4d47-aef1-33511df6f132 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1218 microversion: 2.1 time: 0.205877 Dec 24 04:59:17.564707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:17 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:17.878656 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:17.879614 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:17.894306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:17.895264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:17.898643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:17.899869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:18.217857 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:18.234683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-014512ec-e276-4974-9ad7-8679aa7d5c92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1222 microversion: 2.1 time: 0.359257 Dec 24 04:59:18.248322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:17 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1222 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:18.365659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fde1cbaf-4839-4d86-a55b-57a3db85f5f4 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Calling method '.version_select at 0x7f7baf410af0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:18.871195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-fde1cbaf-4839-4d86-a55b-57a3db85f5f4 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] HTTP exception thrown: Volume a3cd495e-bbd6-4520-974c-56433b9e1112 could not be found. Dec 24 04:59:18.871969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fde1cbaf-4839-4d86-a55b-57a3db85f5f4 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] Returning 404 to user: Volume a3cd495e-bbd6-4520-974c-56433b9e1112 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 04:59:18.873021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fde1cbaf-4839-4d86-a55b-57a3db85f5f4 tempest-VolumesGetTestJSON-1757372225 tempest-VolumesGetTestJSON-1757372225-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112" status: 404 len: 109 microversion: 2.1 time: 0.511596 Dec 24 04:59:18.877045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:18 2021] GET /compute/v2.1/os-volumes/a3cd495e-bbd6-4520-974c-56433b9e1112 => generated 109 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 04:59:18.880224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:18.880772 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:18.904228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:18.904722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:18.905494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:18.905931 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:18.911725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-6f873dea-8d11-453d-a00a-ab2df467387d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:18.919306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-6f873dea-8d11-453d-a00a-ab2df467387d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for user 979cc4a0723b4543a16197d393c7929a and project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:18.966380 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6f873dea-8d11-453d-a00a-ab2df467387d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.892025 Dec 24 04:59:18.976250 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 14/30] 10.222.0.43 () {62 vars in 1198 bytes} [Fri Dec 24 04:59:17 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1901 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 24 04:59:19.147287 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:19.158252 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b886128b-cd26-46f5-83df-4fb29bc8e606 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1266 microversion: 2.1 time: 0.283217 Dec 24 04:59:19.167339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 17/31] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:18 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:19.253860 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:19.254480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:19.266339 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:19.266815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:19.267579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:19.268000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:19.762677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:19.774206 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c7f00023-8ff6-4aa6-b38a-95122b55c290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1214 microversion: 2.1 time: 0.521809 Dec 24 04:59:19.776515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 15/32] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:19 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1214 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:20.182679 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:20.184669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:20.227949 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:20.238860 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:20.243489 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:20.247375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:20.447475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-837351590", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d368baa-5733-40a7-b836-139a541f4ebb"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:20.504152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:20.512214 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1272 microversion: 2.1 time: 0.336532 Dec 24 04:59:20.523357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 16/33] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:20 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:20.550170 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] validate_networks() for [('0d368baa-5733-40a7-b836-139a541f4ebb', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 04:59:20.799058 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:20.800169 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:20.813081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:20.814655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:20.817173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:20.828862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:21.091256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:21.108330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1278 microversion: 2.1 time: 0.310507 Dec 24 04:59:21.114095 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 17/34] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:20 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:21.539303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:21.540028 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:21.552096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:21.552561 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:21.559579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:21.565958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:22.003182 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:22.019320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1272 microversion: 2.1 time: 0.481779 Dec 24 04:59:22.022518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 18/35] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:21 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1272 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:22.131138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:22.132347 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:22.142987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:22.145668 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:22.147156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:22.150800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:22.354254 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:22.384730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-76614315-6ece-48d4-a255-0b896749b97b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1276 microversion: 2.1 time: 0.254476 Dec 24 04:59:22.388959 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 19/36] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:22 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:23.038629 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:23.039918 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:23.049283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:23.050088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:23.051097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:23.051710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:23.236917 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:23.251931 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5095b1d8-8b8d-4333-af30-7607583b5706 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1272 microversion: 2.1 time: 0.214166 Dec 24 04:59:23.253697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:23 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:23.322061 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 04:59:23.323007 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 04:59:23.323679 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 04:59:23.324295 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 04:59:23.324947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 04:59:23.347644 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:23.349816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:23.350899 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:23.355269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:23.399018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Getting quotas for project 1b651e55b1a349a0b9582c526d3b5d67. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:23.412101 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:23.413291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:23.413911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Getting quotas for user fa2aab5929e746dbbc011b42927b8e37 and project 1b651e55b1a349a0b9582c526d3b5d67. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:23.426733 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:23.428445 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:23.430708 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:23.431316 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:23.446893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 04:59:23.450090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 04:59:23.560596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e06507d6-4b16-4a58-b571-46613445ae79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.591262 Dec 24 04:59:23.561962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 18/38] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 04:59:19 2021] POST /compute/v2.1/servers => generated 383 bytes in 3593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 04:59:23.571631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-05790bee-616f-48f3-8da7-0582c20bf5cb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:23.572860 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-05790bee-616f-48f3-8da7-0582c20bf5cb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:23.662739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:23.673209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1276 microversion: 2.1 time: 0.267421 Dec 24 04:59:23.676143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 21/39] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:23 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:23.838026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-05790bee-616f-48f3-8da7-0582c20bf5cb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:23.845720 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-05790bee-616f-48f3-8da7-0582c20bf5cb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1221 microversion: 2.1 time: 0.277571 Dec 24 04:59:23.856985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 19/40] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:23 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:24.249973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-28050353", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d368baa-5733-40a7-b836-139a541f4ebb"}]}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:24.269368 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:24.270235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:24.280596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:24.281053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:24.289540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:24.294146 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:24.416155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] validate_networks() for [('0d368baa-5733-40a7-b836-139a541f4ebb', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 04:59:24.654130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:24.666137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7789d859-c4eb-4cc3-964f-83a21df7deca tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1272 microversion: 2.1 time: 0.399755 Dec 24 04:59:24.670579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 20/41] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:24 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1272 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:24.695883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:24.696895 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:24.723992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:24.726784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:24.729147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:24.731153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:25.791294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 04:59:25.791903 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 04:59:25.792234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 04:59:25.792700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 04:59:25.793119 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 04:59:25.812035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:25.812511 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:25.813844 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:25.814430 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:25.858401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Getting quotas for project 1b651e55b1a349a0b9582c526d3b5d67. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:25.867821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Getting quotas for user fa2aab5929e746dbbc011b42927b8e37 and project 1b651e55b1a349a0b9582c526d3b5d67. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:25.890326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 04:59:25.892793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 04:59:26.002124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d9b65ee9-8c1e-4fb9-9246-88698528c21a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.748563 Dec 24 04:59:26.002124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 04:59:24 2021] POST /compute/v2.1/servers => generated 383 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 04:59:26.013133 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:26.013847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:26.034856 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:26.035314 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:26.037796 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:26.054644 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:26.456256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:26.469022 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0679074e-44c6-44da-a836-80fb01d00ae5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 1.777229 Dec 24 04:59:26.471734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:24 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:26.482025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0b3e6f43-7316-4241-9426-fe50608706e3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:26.488285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0b3e6f43-7316-4241-9426-fe50608706e3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:26.659819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:26.674643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.671573 Dec 24 04:59:26.675236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 23/44] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:25 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:26.682249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0b3e6f43-7316-4241-9426-fe50608706e3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:26.691276 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0b3e6f43-7316-4241-9426-fe50608706e3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1220 microversion: 2.1 time: 0.217396 Dec 24 04:59:26.701838 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 22/45] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:26 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1220 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:26.896164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-978284096", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c908572e-3b6b-470c-8b88-35b51f1472c6"}], "security_groups": [{"name": "tempest-securitygroup--238748369"}], "key_name": "tempest-keypair-1111329987", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:27.487538 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:27.488493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:27.497778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:27.498223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:27.499014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:27.499439 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:27.535655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] validate_networks() for [('c908572e-3b6b-470c-8b88-35b51f1472c6', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 04:59:28.356509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:28.365288 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.881769 Dec 24 04:59:28.369389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 23/46] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:27 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:28.380551 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:28.384783 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:28.429455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:28.433140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:28.436803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:28.439063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:29.121958 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:29.134411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7a052663-6a89-4421-90e0-4b60db0b4e2f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.758776 Dec 24 04:59:29.134411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 24/47] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:28 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:29.145222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:29.149033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:29.170589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:29.171053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:29.171876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:29.175701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:29.522176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:29.532326 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b3d8d394-e01b-418d-8678-580064e969cd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1216 microversion: 2.1 time: 0.399324 Dec 24 04:59:29.543228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 25/48] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:29 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1216 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:29.550641 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-495cfbb7-ea66-42a6-bee6-ebce513044d4 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baeb30280>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:29.623609 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-495cfbb7-ea66-42a6-bee6-ebce513044d4 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a91fad13-cc82-4eae-b4b1-4f698d6ed9dd" status: 200 len: 350 microversion: 2.1 time: 0.078693 Dec 24 04:59:29.625730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 26/49] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:29 2021] GET /compute/v2.1/os-volumes/a91fad13-cc82-4eae-b4b1-4f698d6ed9dd => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:29.631874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:29.632804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:29.645476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:29.648621 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:29.650269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:29.651808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:29.835782 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 04:59:29.838302 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 04:59:29.841076 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 04:59:29.842292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 04:59:29.843771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 04:59:29.875532 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:29.876321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:29.876805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:29.877340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:29.914669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:29.929553 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for user 979cc4a0723b4543a16197d393c7929a and project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:29.949551 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 04:59:29.951901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 04:59:30.073740 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-792ce83f-357e-48f4-95ed-aa45505c1150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.179990 Dec 24 04:59:30.073740 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 24/50] 10.222.0.43 () {62 vars in 1187 bytes} [Fri Dec 24 04:59:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 3186 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 24 04:59:30.173075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:30.173075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-471e799d-1cad-46d7-878d-c6d660c269d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.544051 Dec 24 04:59:30.173075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 27/51] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:29 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:30.186738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f99aeef-e04a-4ac7-a532-528a338df791 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:30.187360 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f99aeef-e04a-4ac7-a532-528a338df791 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:30.337322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-4e450259-ad5f-4d55-b9cc-e814528401fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:30.340573 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:30.340573 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 04:59:30.355753 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-4e450259-ad5f-4d55-b9cc-e814528401fd service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:30.361161 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-4e450259-ad5f-4d55-b9cc-e814528401fd service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:30.427118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-4e450259-ad5f-4d55-b9cc-e814528401fd service nova] Creating event network-changed:50d50f46-e761-4fb1-9761-fa48778aa8aa for instance 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e on hv-cinder-81644 Dec 24 04:59:30.429128 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-4e450259-ad5f-4d55-b9cc-e814528401fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=116329) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 24 04:59:30.433077 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab87a483-2631-4991-aaef-334eccc2d498 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:30.433731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab87a483-2631-4991-aaef-334eccc2d498 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:30.439573 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab87a483-2631-4991-aaef-334eccc2d498 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:30.440616 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab87a483-2631-4991-aaef-334eccc2d498 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:30.461248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.compute.rpcapi [None req-ab87a483-2631-4991-aaef-334eccc2d498 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 24 04:59:30.462205 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab87a483-2631-4991-aaef-334eccc2d498 None None] Releasing lock "compute-rpcapi-router" {{(pid=116329) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 24 04:59:30.498342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f99aeef-e04a-4ac7-a532-528a338df791 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:30.501989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ab87a483-2631-4991-aaef-334eccc2d498 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.419188 Dec 24 04:59:30.503121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 25/52] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:30.508558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f99aeef-e04a-4ac7-a532-528a338df791 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:30.513603 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:30.515166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f99aeef-e04a-4ac7-a532-528a338df791 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:30.516289 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:30.519549 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f99aeef-e04a-4ac7-a532-528a338df791 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1281 microversion: 2.20 time: 0.339140 Dec 24 04:59:30.525886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 28/53] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:30 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1281 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:30.540808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:30.549695 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:30.550614 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:30.558277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:30.559430 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:30.560300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:30.562808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:30.566904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:30.568514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:30.569871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:30.677590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:30.686704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-16271348-f1d4-4cf5-83dd-0b581d44ae5a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1272 microversion: 2.1 time: 0.141013 Dec 24 04:59:30.687801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 29/54] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:30 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:31.179829 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:31.188684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:31.189403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:31.204268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.693923 Dec 24 04:59:31.206036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 26/55] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:30 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:31.207522 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:31.207972 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:31.208819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:31.209246 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:31.496892 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:31.507770 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.323645 Dec 24 04:59:31.508979 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 30/56] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:31 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:31.548709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:31.549522 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:31.565678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:31.566132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:31.566951 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:31.567389 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:31.681486 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:31.692162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:31.694368 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:31.697531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a2afeb52-afe8-4a70-bb55-1a7549c82afe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1285 microversion: 2.20 time: 0.161554 Dec 24 04:59:31.698366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 27/57] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:31 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:31.707213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:31.707827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:31.715708 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:31.716345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:31.717502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:31.718119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:31.794582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:31.814455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f2e07ed-653e-4c4d-b13c-6ac03492640d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1280 microversion: 2.1 time: 0.111753 Dec 24 04:59:31.815035 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 31/58] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:31 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1280 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:31.933264 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-063a1482-57f7-4957-8112-55c460a3e821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:31.935339 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:31.935339 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 04:59:31.945340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-063a1482-57f7-4957-8112-55c460a3e821 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:31.945340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-063a1482-57f7-4957-8112-55c460a3e821 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:31.959492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-063a1482-57f7-4957-8112-55c460a3e821 service nova] Creating event network-changed:c20bf82b-830b-4f29-b2bf-97f490cf78c9 for instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe on hv-cinder-81644 Dec 24 04:59:31.965378 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-063a1482-57f7-4957-8112-55c460a3e821 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182578 Dec 24 04:59:31.966747 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 28/59] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 04:59:32.236499 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:32.237361 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:32.244499 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.245026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.245994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.246431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.428069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:32.437998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.215573 Dec 24 04:59:32.439910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 32/60] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:32 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:32.525413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:32.526204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:32.533439 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.533921 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.534820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.535272 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.716350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:32.716997 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:32.725283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:32.738659 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-60b03bd9-3b46-4819-80fb-6f6a14a364fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.216723 Dec 24 04:59:32.739673 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 29/61] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:32 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:32.745835 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.746540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.747602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.754260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.761695 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e93a4ded-b0f3-4650-bf09-4a91875eadab tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7bae24baf0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:32.877318 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e93a4ded-b0f3-4650-bf09-4a91875eadab tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cd8d958d-a6a3-47a2-8151-231853d83edf" status: 200 len: 351 microversion: 2.1 time: 0.128405 Dec 24 04:59:32.877579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:32.877867 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 30/62] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:32 2021] GET /compute/v2.1/os-volumes/cd8d958d-a6a3-47a2-8151-231853d83edf => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:32.882182 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:32.882776 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:32.887555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:32.889731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:32.891914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7d796953-a20f-4f49-bd7b-064262876baa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1285 microversion: 2.20 time: 0.179095 Dec 24 04:59:32.895346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.900144 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.902500 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:32.904094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:32.904400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 33/63] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:32 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:33.034412 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:33.052213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1280 microversion: 2.1 time: 0.173260 Dec 24 04:59:33.064610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 31/64] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:32 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:33.457438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:33.458513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:33.465453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:33.466207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:33.467046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:33.467523 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:33.667983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:33.676200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-04307fa8-1b1a-47ba-bad0-5853cf950dbf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.223584 Dec 24 04:59:33.686204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 34/65] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:33 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:33.757619 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:33.758415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:33.767922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:33.768709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:33.770506 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:33.771045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:33.911204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:33.911796 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:33.918566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:33.919217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:33.920210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:33.920686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:33.983075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:33.993179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.240447 Dec 24 04:59:33.997189 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 32/66] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:33 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:34.009733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:34.022522 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:34.024676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:34.026108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1285 microversion: 2.20 time: 0.118549 Dec 24 04:59:34.027086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 35/67] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:33 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 04:59:34.069292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:34.070088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:34.076254 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:34.076996 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:34.077995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:34.078701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:34.152715 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:34.161395 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1280 microversion: 2.1 time: 0.096029 Dec 24 04:59:34.161990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 33/68] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:34 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:34.693566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:34.694124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:34.699912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:34.700354 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:34.701160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:34.701609 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:34.836174 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:34.845319 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a90c3427-1c24-4e09-8d25-df19e19f644f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.155387 Dec 24 04:59:34.846048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 36/69] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:34 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:35.013151 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:35.013768 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:35.020045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.020515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:35.021308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.021771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:35.047415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:35.048341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:35.054896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.055339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:35.056184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.056897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:35.122243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:35.135622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:35.137622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:35.138846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1285 microversion: 2.20 time: 0.095591 Dec 24 04:59:35.140439 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 37/70] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:35 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 04:59:35.178221 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:35.179310 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:35.187054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.187715 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:35.189271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.190156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:35.260961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:35.269649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-458fccde-4d9b-4ffd-96ac-b2de021c26ab tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1280 microversion: 2.1 time: 0.095344 Dec 24 04:59:35.270547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 38/71] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:35 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:35.348816 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:35.356136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cd687940-07af-4802-b510-2790c5a906d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.346788 Dec 24 04:59:35.356817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 34/72] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:35 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:35.865734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:35.866376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:35.875245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.875960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:35.876843 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:35.877278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:36.025116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:36.035196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-efed455a-3cd7-44f6-ad1e-de54d93a035a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.175506 Dec 24 04:59:36.035800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 39/73] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:35 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:36.158356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:36.159088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:36.166627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:36.167142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:36.168045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:36.168583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:36.229742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:36.238308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:36.239795 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:36.240908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-86c1e1ba-1a50-4e51-a67d-cff8db449498 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1285 microversion: 2.20 time: 0.086966 Dec 24 04:59:36.241507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 35/74] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:36 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:36.288702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:36.289560 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:36.298165 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:36.298612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:36.299377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:36.299803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:36.362189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:36.370000 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ced46162-60e9-4b35-9788-f356affe1f5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1280 microversion: 2.1 time: 0.087108 Dec 24 04:59:36.370586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 40/75] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:36 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:36.373103 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:36.373733 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:36.379944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:36.380386 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:36.381181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:36.381613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:36.514687 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:36.522238 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.152966 Dec 24 04:59:36.522796 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 36/76] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:36 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:37.053073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:37.053629 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:37.059972 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.060427 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.061234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.061660 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.191364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:37.199617 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.150406 Dec 24 04:59:37.200220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 41/77] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:37 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:37.259356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:37.262738 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:37.269342 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.269778 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.270554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.270974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.334051 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:37.342394 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:37.343864 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:37.345120 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8794692c-2755-4c4a-accd-f49f2c3a5e39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1285 microversion: 2.20 time: 0.089694 Dec 24 04:59:37.345671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 37/78] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:37 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:37.386648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:37.387420 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:37.393991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.394495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.395355 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.395803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.454517 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:37.462438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2194e1b0-343a-4a01-a48c-83453d89ef26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1280 microversion: 2.1 time: 0.079410 Dec 24 04:59:37.462967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 42/79] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:37 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1280 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:37.538666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:37.539293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:37.545536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.546224 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.547185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:37.547592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:37.677734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:37.686682 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.151578 Dec 24 04:59:37.687306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 38/80] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:37 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:38.221306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:38.221966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:38.229398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.229920 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.230793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.231324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.363248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:38.363833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:38.369818 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.370270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.371078 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.371509 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.374650 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:38.382260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0b021145-128f-493d-887b-c54e3cb8b6b1 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.166817 Dec 24 04:59:38.382840 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 43/81] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:38 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:38.430373 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:38.438850 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:38.440335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:38.441446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1285 microversion: 2.20 time: 0.082105 Dec 24 04:59:38.442000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 39/82] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:38 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 04:59:38.479892 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:38.480441 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:38.486992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.487431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.488181 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.488628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.546196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:38.554260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1280 microversion: 2.1 time: 0.078081 Dec 24 04:59:38.554826 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 44/83] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:38 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:38.708655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:38.709271 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:38.716054 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.716501 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.717301 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:38.717869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:38.879889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:38.909876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.204628 Dec 24 04:59:38.910543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 40/84] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:38 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:39.399985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:39.400732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:39.410555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.411077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:39.411930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.412439 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:39.459239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:39.460755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:39.467575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.468193 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:39.469336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.470120 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:39.570244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:39.580640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:39.585425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:39.587242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1333 microversion: 2.20 time: 0.131225 Dec 24 04:59:39.588995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 41/85] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:39 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1333 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:39.605124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:39.606984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:39.615941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.616767 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:39.617602 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.618225 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:39.769894 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:39.784787 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c887df51-7943-4976-a850-6bed68779169 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1278 microversion: 2.1 time: 0.193526 Dec 24 04:59:39.786432 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 42/86] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:39 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:39.792384 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-88ff73c2-bae4-4a34-87ea-87fb0d52bc37 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7bae24b8b0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:39.860755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:39.870836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.475469 Dec 24 04:59:39.875119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 45/87] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:39 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:39.890748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-88ff73c2-bae4-4a34-87ea-87fb0d52bc37 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/4038442e-c254-43ea-a242-9d90939f0b26" status: 200 len: 349 microversion: 2.1 time: 0.102181 Dec 24 04:59:39.899134 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 43/88] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 04:59:39 2021] GET /compute/v2.1/os-volumes/4038442e-c254-43ea-a242-9d90939f0b26 => generated 349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:39.903529 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dc0d5709-63f3-457b-a1f7-6801afa5fa14 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7bafd79a60>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:39.927383 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:39.928308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:39.936162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.937293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:39.938345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:39.938965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:40.058927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dc0d5709-63f3-457b-a1f7-6801afa5fa14 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.159561 Dec 24 04:59:40.060007 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 46/89] 10.222.0.43 () {58 vars in 1133 bytes} [Fri Dec 24 04:59:39 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:40.073062 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5c6aa784-5fcd-4ad1-b77a-ccd0bf8721cb tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baeb5c1f0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.178397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5c6aa784-5fcd-4ad1-b77a-ccd0bf8721cb tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.108980 Dec 24 04:59:40.178983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 47/90] 10.222.0.43 () {58 vars in 1148 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:40.193222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75ad686b-0d0b-41f5-ae86-4d4e3c69cd88 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baeb30b80>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.286312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75ad686b-0d0b-41f5-ae86-4d4e3c69cd88 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.098120 Dec 24 04:59:40.287104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 48/91] 10.222.0.43 () {58 vars in 1133 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:40.298194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-27ad0b5b-b581-4b79-9f2a-0bccf73b3b6e tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baeb30700>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.385688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-27ad0b5b-b581-4b79-9f2a-0bccf73b3b6e tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091125 Dec 24 04:59:40.388580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 49/92] 10.222.0.43 () {58 vars in 1166 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 04:59:40.398369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1e9e1a47-9d08-4c49-8161-e623bc601790 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baeb764c0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.483333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1e9e1a47-9d08-4c49-8161-e623bc601790 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088692 Dec 24 04:59:40.483912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 50/93] 10.222.0.43 () {58 vars in 1169 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 04:59:40.495913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ea1eb5b3-ae8e-46d6-b8fa-91238126d84a tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baebc6820>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.577056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ea1eb5b3-ae8e-46d6-b8fa-91238126d84a tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084496 Dec 24 04:59:40.577730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 51/94] 10.222.0.43 () {58 vars in 1154 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:40.589406 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e0b0ed02-51b4-46b0-9759-661dd659d214 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baeb1ab80>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.677411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e0b0ed02-51b4-46b0-9759-661dd659d214 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091292 Dec 24 04:59:40.677909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 52/95] 10.222.0.43 () {58 vars in 1187 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:40.689196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.689804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:40.695919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:40.696646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:40.697489 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:40.697918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:40.758316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:40.770036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:40.771517 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:40.772633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1339 microversion: 2.20 time: 0.087323 Dec 24 04:59:40.773179 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 53/96] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:40.778709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-18958600-398b-4998-ad79-815fe16913d9 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] Calling method '.version_select at 0x7f7baeb1a310>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.862697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-18958600-398b-4998-ad79-815fe16913d9 tempest-VolumesTestJSON-192899718 tempest-VolumesTestJSON-192899718-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088418 Dec 24 04:59:40.863264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 54/97] 10.222.0.43 () {58 vars in 1154 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:40.867022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:40.867538 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.868131 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:40.876632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:40.877063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:40.878135 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:40.878712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:40.881412 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.958207 Dec 24 04:59:40.893688 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 44/98] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:39 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:40.899325 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:40.900104 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:40.907506 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:40.908825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:40.909962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:40.910536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:40.943753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:40.953042 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e7c64b83-0006-4152-8e34-77f39b1bbb07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1278 microversion: 2.1 time: 0.088699 Dec 24 04:59:40.954133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 55/99] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:41.468957 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-50555602-d064-4f56-b687-aefa24a4d582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:41.471505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:41.471505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 04:59:41.488197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-94443b49-3099-4f74-9e6f-c20c97783531 req-50555602-d064-4f56-b687-aefa24a4d582 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:41.490499 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-94443b49-3099-4f74-9e6f-c20c97783531 req-50555602-d064-4f56-b687-aefa24a4d582 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:41.525551 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:41.544315 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d31362ce-5b77-4c94-ba01-1880df3d987e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.648815 Dec 24 04:59:41.544955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 45/100] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:40 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:41.552643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-94443b49-3099-4f74-9e6f-c20c97783531 req-50555602-d064-4f56-b687-aefa24a4d582 service nova] Creating event network-changed:ea61b5c0-ffb7-42bf-9289-095515c125a2 for instance 27408900-d9e8-47e1-be4d-aac80e3f6fae on hv-cinder-81644 Dec 24 04:59:41.554034 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-94443b49-3099-4f74-9e6f-c20c97783531 req-50555602-d064-4f56-b687-aefa24a4d582 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116330) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 24 04:59:41.559184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-684e23c3-8dd7-4cd2-bc7c-73fd8e6b6d50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:41.559896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-684e23c3-8dd7-4cd2-bc7c-73fd8e6b6d50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:41.561291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-684e23c3-8dd7-4cd2-bc7c-73fd8e6b6d50 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:41.562114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-684e23c3-8dd7-4cd2-bc7c-73fd8e6b6d50 None None] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:41.576742 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.compute.rpcapi [None req-684e23c3-8dd7-4cd2-bc7c-73fd8e6b6d50 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 24 04:59:41.577910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-684e23c3-8dd7-4cd2-bc7c-73fd8e6b6d50 None None] Releasing lock "compute-rpcapi-router" {{(pid=116330) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 24 04:59:41.606014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-684e23c3-8dd7-4cd2-bc7c-73fd8e6b6d50 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141193 Dec 24 04:59:41.606813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 56/101] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:41.799139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:41.799923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:41.806280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:41.814186 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:41.814186 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:41.814186 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:41.898133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:41.898910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:41.908285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:41.909025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:41.910218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:41.910921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:41.955769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:41.967666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:41.969652 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:41.971435 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1339 microversion: 2.20 time: 0.178152 Dec 24 04:59:41.972775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 46/102] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:41 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:42.022826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:42.024271 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:42.030855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:42.031583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:42.032548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:42.033591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:42.084992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:42.096309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-510fa22f-7250-402a-aa5f-300e3a904f77 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.200182 Dec 24 04:59:42.097387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 57/103] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:41 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:42.561397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:42.562087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:42.568159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:42.568762 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:42.569603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:42.570089 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:42.769111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:42.778596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6e606968-f83d-4ad8-96e3-fbd5953ad889 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.221056 Dec 24 04:59:42.779387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 58/104] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:42 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:42.816244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:42.832720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.813298 Dec 24 04:59:42.834954 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 47/105] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:42 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:43.001050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:43.003193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:43.020198 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.026918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:43.028302 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.028399 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:43.114465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:43.115694 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:43.122540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.125085 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:43.128888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.129631 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:43.309018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:43.320629 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:43.324939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:43.327455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.340837 Dec 24 04:59:43.329414 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 59/106] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:42 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:43.700935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:43.712537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9a047885-ef73-4105-aa7c-ba781701301e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.602779 Dec 24 04:59:43.713554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 48/107] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:43 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:43.795157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:43.795752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:43.804369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.804835 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:43.806301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.807537 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:43.852393 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:43.853333 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:43.864869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.865650 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:43.866995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:43.867771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:44.017228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:44.032093 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-23c630fa-e806-47c9-81d0-8699fc96b759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.240345 Dec 24 04:59:44.042612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 60/108] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:43 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:44.349630 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:44.350628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:44.358685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:44.359318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:44.360553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:44.361175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:44.654704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:44.665159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:44.668099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:44.672701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.327757 Dec 24 04:59:44.673105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 61/109] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:44 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 04:59:44.681602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-58e888c7-7de1-4094-9db5-5624fae2df5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "tag": "24d08627-8243-4361-b6b4-8461a18d110f"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:44.692993 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:44.705383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:44.705383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 04:59:44.713230 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-74ff9184-162c-4618-8ac4-26a9ee50da55 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.863368 Dec 24 04:59:44.714178 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 49/110] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:43 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:44.728432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-58e888c7-7de1-4094-9db5-5624fae2df5e service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:44.729327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-58e888c7-7de1-4094-9db5-5624fae2df5e service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:44.729536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:44.730142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:44.743315 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:44.744050 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:44.744909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:44.745330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:44.752657 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-58e888c7-7de1-4094-9db5-5624fae2df5e service nova] Creating event network-changed:24d08627-8243-4361-b6b4-8461a18d110f for instance 580344bb-42e6-4fd7-967d-04e85d821fd2 on hv-cinder-81644 Dec 24 04:59:44.763563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-58e888c7-7de1-4094-9db5-5624fae2df5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086804 Dec 24 04:59:44.765511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 62/111] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:45.054254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:45.057159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:45.073409 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:45.074574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:45.076854 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:45.080144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:45.451478 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:45.459570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-200701c9-5ab7-479c-9dc4-f4d4204f9050 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.733757 Dec 24 04:59:45.460906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 50/112] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:44 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:45.543202 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:45.551430 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.504959 Dec 24 04:59:45.563052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 63/113] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:45 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:45.691335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:45.691980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:45.706279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:45.708033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:45.709163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:45.710152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:45.741401 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:45.743863 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:45.771021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:45.771488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:45.772313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:45.776307 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:46.127031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:46.139889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4b74c73f-064c-44fb-b110-fe94aace199e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.412469 Dec 24 04:59:46.140861 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 64/114] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:45 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:46.391834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:46.399839 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:46.403530 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:46.407802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-84505c28-513a-4051-87b9-c2ca82cf65ef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.720365 Dec 24 04:59:46.424611 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 51/115] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:45 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:46.477718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:46.478324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:46.484501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:46.484967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:46.485948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:46.486372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:46.571684 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:46.572875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:46.581296 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:46.582044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:46.583347 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:46.584079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:46.737880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:46.745780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2fa85cc1-3a8c-4838-b6fa-193298ff246e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.271600 Dec 24 04:59:46.746923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 65/116] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:46 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:46.794995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:46.796983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:46.796983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 04:59:46.810635 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:46.811071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:46.822965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e service nova] Creating event network-changed:61ec3441-5b75-4c07-b8ad-4174450d6a55 for instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 on hv-cinder-81644 Dec 24 04:59:46.829438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039989 Dec 24 04:59:46.830699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 66/117] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 04:59:47.120139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:47.133641 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-98be1ba9-f733-47d4-8ab7-f82d687bc570 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.565669 Dec 24 04:59:47.146248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 52/118] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:46 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:47.158192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:47.159286 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:47.167766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:47.168221 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:47.169294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:47.169709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:47.371570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:47.381374 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7c398f47-aa84-4201-a220-9779982d4f85 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.227954 Dec 24 04:59:47.383897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 67/119] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:47 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:47.429489 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:47.430148 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:47.442223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:47.442790 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:47.444976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:47.446005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:47.768767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:47.770030 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:47.796688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:47.799583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:47.801739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:47.806982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:47.840261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:47.854661 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:47.863010 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:47.866148 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-915c4afe-4225-426a-adc4-1b9bbd768b1a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.442381 Dec 24 04:59:47.868088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 53/120] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:47 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:48.153522 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:48.157008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:48.174962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:48.175681 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:48.177157 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:48.177894 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:48.267246 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:48.284056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-68b32df8-7227-4ef4-9306-35cfbf491875 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.522261 Dec 24 04:59:48.286124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 68/121] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:47 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:48.400265 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:48.400265 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:48.412142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:48.412674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:48.413496 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:48.413935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:48.630157 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:48.642519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9427ecbd-d746-4351-853b-218e0d71366b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.493975 Dec 24 04:59:48.643463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:48.645508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 54/122] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:48 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:48.653342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aee29f56-47f4-4381-beec-8cee00edd1db tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.257712 Dec 24 04:59:48.654866 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 69/123] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:48 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:48.899221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:48.900271 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:48.909877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:48.912278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:48.915341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:48.915953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.031745 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-84176541-336b-4206-985f-4c364e83cd80 req-2b572a57-b921-4ddb-8306-4ac9336565e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "name": "network-vif-plugged", "status": "completed", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:49.034137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:49.034137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 04:59:49.043714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-84176541-336b-4206-985f-4c364e83cd80 req-2b572a57-b921-4ddb-8306-4ac9336565e7 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:49.044185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-84176541-336b-4206-985f-4c364e83cd80 req-2b572a57-b921-4ddb-8306-4ac9336565e7 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.057626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-84176541-336b-4206-985f-4c364e83cd80 req-2b572a57-b921-4ddb-8306-4ac9336565e7 service nova] Creating event network-vif-plugged:50d50f46-e761-4fb1-9761-fa48778aa8aa for instance 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e on hv-cinder-81644 Dec 24 04:59:49.062897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-84176541-336b-4206-985f-4c364e83cd80 req-2b572a57-b921-4ddb-8306-4ac9336565e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105404 Dec 24 04:59:49.063931 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 70/124] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 04:59:49.110373 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:49.118265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:49.119726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:49.121552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.226610 Dec 24 04:59:49.124569 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 55/125] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:48 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:49.305470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:49.306288 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:49.312313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:49.314535 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.315868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:49.317223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.476576 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:49.484324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-797f811a-966b-473d-bf3a-253a668186c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.182884 Dec 24 04:59:49.484950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 71/126] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:49 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:49.659874 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:49.660478 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:49.671359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:49.671953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:49.672084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:49.672823 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.674120 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:49.674632 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.678422 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:49.678868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.679637 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:49.680067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:49.816121 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:49.824110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-507edb97-efc4-4cb7-82ab-bea8bbd91924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.156716 Dec 24 04:59:49.824731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 72/127] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:49 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:49.829213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1627168215", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "c2c27570-f2cd-4dac-9473-e82a4e432501"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:49.871927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:49.879185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b19c1ab9-f716-4274-ad39-76e211e64bb3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.223256 Dec 24 04:59:49.879746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 56/128] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:49 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:49.882185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] validate_networks() for [('c2c27570-f2cd-4dac-9473-e82a4e432501', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 04:59:50.139503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:50.140252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:50.152041 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.152486 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.155146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.155590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.341254 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:50.346507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 04:59:50.347069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 04:59:50.347775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 04:59:50.350028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 04:59:50.350669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:50.350820 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 04:59:50.352279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:50.353406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.218160 Dec 24 04:59:50.353971 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 57/129] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:50 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 04:59:50.368454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.369592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.371087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.372121 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.389928 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Getting quotas for project 1e014b3683d841968563e0aa0705e862. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 04:59:50.394993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Getting quotas for user fbefbd7e98c94b7598f4af35532d60cb and project 1e014b3683d841968563e0aa0705e862. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 04:59:50.406352 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 04:59:50.408899 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 04:59:50.459244 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b1cce6d9-3f33-40fd-a928-1207280d20e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633454 Dec 24 04:59:50.460481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 73/130] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 04:59:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 04:59:50.471612 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0f0ccc6f-ffd1-4134-952b-3001087f5950 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:50.472274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0f0ccc6f-ffd1-4134-952b-3001087f5950 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:50.499811 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:50.501097 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:50.507915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.508564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.509482 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.510050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.549562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0f0ccc6f-ffd1-4134-952b-3001087f5950 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:50.556843 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0f0ccc6f-ffd1-4134-952b-3001087f5950 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1214 microversion: 2.1 time: 0.089530 Dec 24 04:59:50.557508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 58/131] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:50 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:50.719342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:50.727438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b95aacfb-4288-4639-b578-da810675a2ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.231216 Dec 24 04:59:50.728049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 74/132] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:50 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:50.840830 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:50.841475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:50.852408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.853256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.853964 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.854335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.895235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:50.896110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:50.902815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.903491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:50.904462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:50.905110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.004478 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:51.020447 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b433aee8-0434-4030-b352-10e5b7626cbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.183310 Dec 24 04:59:51.029945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 59/133] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:50 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:51.074804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:51.082685 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-e7e1280f-8c70-497c-8ac4-470fedd867f9 req-892f4403-d350-46f7-a31f-1bed6309f99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-plugged", "status": "completed", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:51.084998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:51.084998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 04:59:51.090286 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.197448 Dec 24 04:59:51.092590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-e7e1280f-8c70-497c-8ac4-470fedd867f9 req-892f4403-d350-46f7-a31f-1bed6309f99f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:51.093032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-e7e1280f-8c70-497c-8ac4-470fedd867f9 req-892f4403-d350-46f7-a31f-1bed6309f99f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.093149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 75/134] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:50 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:51.104954 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-e7e1280f-8c70-497c-8ac4-470fedd867f9 req-892f4403-d350-46f7-a31f-1bed6309f99f service nova] Creating event network-vif-plugged:c20bf82b-830b-4f29-b2bf-97f490cf78c9 for instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe on hv-cinder-81644 Dec 24 04:59:51.110171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-e7e1280f-8c70-497c-8ac4-470fedd867f9 req-892f4403-d350-46f7-a31f-1bed6309f99f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031464 Dec 24 04:59:51.111061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 60/135] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:51.371964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:51.373257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:51.379833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:51.380385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.381098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:51.381523 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.537236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:51.553864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:51.555436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:51.556620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f25ab987-1a8e-438e-84a7-00ddb7430c8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.188443 Dec 24 04:59:51.564557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 76/136] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:51 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:51.573875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:51.574885 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:51.581816 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:51.582268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.583109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:51.583608 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.651232 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:51.659102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b6a4627c-13a7-4285-8026-7f72cd12a85d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1266 microversion: 2.1 time: 0.089056 Dec 24 04:59:51.659743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 61/137] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:51 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:51.745187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:51.745791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:51.752191 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:51.752671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.753430 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:51.753842 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:51.909896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:51.916932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1318 microversion: 2.1 time: 0.175759 Dec 24 04:59:51.917479 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 77/138] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:51 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:52.037525 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:52.038159 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:52.043980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.044419 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.045252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.045684 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.109253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:52.110103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:52.116805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.117519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.119413 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.120262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.280518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:52.288973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.254971 Dec 24 04:59:52.298846 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 62/139] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:52 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:52.383916 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:52.392968 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a1c25cb2-eb5f-453d-bb93-adf87165b702 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1314 microversion: 2.1 time: 0.287511 Dec 24 04:59:52.402862 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 78/140] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:52 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:52.578926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:52.579923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:52.587355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.588737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.590208 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.591518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.680548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:52.681551 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:52.687844 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.688364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.689262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.689748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.757565 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:52.766495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-78daab25-c7a0-4836-909f-fba1220a1aa5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1272 microversion: 2.1 time: 0.092530 Dec 24 04:59:52.767485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 79/141] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:52 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:52.808233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:52.817764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:52.824754 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:52.825879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.252701 Dec 24 04:59:52.826652 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 63/142] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:52 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:52.932964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:52.933570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:52.939941 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.940377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:52.941178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:52.941597 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.127522 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-f3d2d229-ca6d-4acc-8323-38787c4fd6a9 req-179133f1-7a65-49ad-8829-5060db32b75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "name": "network-vif-plugged", "status": "completed", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:53.129779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:53.129779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 04:59:53.139579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-f3d2d229-ca6d-4acc-8323-38787c4fd6a9 req-179133f1-7a65-49ad-8829-5060db32b75c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.142839 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-f3d2d229-ca6d-4acc-8323-38787c4fd6a9 req-179133f1-7a65-49ad-8829-5060db32b75c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.159394 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-f3d2d229-ca6d-4acc-8323-38787c4fd6a9 req-179133f1-7a65-49ad-8829-5060db32b75c service nova] Creating event network-vif-plugged:ea61b5c0-ffb7-42bf-9289-095515c125a2 for instance 27408900-d9e8-47e1-be4d-aac80e3f6fae on hv-cinder-81644 Dec 24 04:59:53.166763 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-f3d2d229-ca6d-4acc-8323-38787c4fd6a9 req-179133f1-7a65-49ad-8829-5060db32b75c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042977 Dec 24 04:59:53.167422 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:53.167577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 64/143] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 04:59:53.176079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-57f6834e-008a-4fec-b5a7-66d2cc15a129 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1509 microversion: 2.1 time: 0.246587 Dec 24 04:59:53.176674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 80/144] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:52 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:53.306773 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:53.307775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:53.328446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.329345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.330565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.332043 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.412625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:53.414925 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:53.424794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.425768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.426801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.427462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.635664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:53.645517 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-97c6acfd-818e-47f8-8db8-ee346c46df81 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1501 microversion: 2.1 time: 0.239113 Dec 24 04:59:53.657661 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 81/145] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:53 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1501 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:53.660741 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:53.677355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2c88b459-f200-4325-9741-656015bd6249 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.375735 Dec 24 04:59:53.679372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 65/146] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:53 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:53.785010 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:53.785627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:53.791712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.792143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.793026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.793394 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.850451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:53.852073 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:53.860641 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.861420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.862491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:53.863292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:53.979386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:53.988885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8a897ae6-3ae3-41af-a811-656cc6cdd637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.209250 Dec 24 04:59:53.993236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 82/147] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:53 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:54.093399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:54.103420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:54.105019 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:54.106527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0ae71f55-1bcb-47b9-af16-da86ce1794ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.264503 Dec 24 04:59:54.109444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 66/148] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:53 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:54.153826 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-b9180766-1783-4f63-b788-3039244b6a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:54.155614 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:54.155614 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 04:59:54.163022 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-b9180766-1783-4f63-b788-3039244b6a7b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:54.174400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-b9180766-1783-4f63-b788-3039244b6a7b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:54.191867 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-b9180766-1783-4f63-b788-3039244b6a7b service nova] Creating event network-changed:95dbce62-23b4-409c-85a9-e1a32a7eb1bb for instance 1f2eb78b-9eeb-4011-b480-333a74a448a7 on hv-cinder-81644 Dec 24 04:59:54.197358 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-b9180766-1783-4f63-b788-3039244b6a7b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047007 Dec 24 04:59:54.198043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 83/149] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:54.626944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a6fdc8cf-5982-44b9-af97-4ec20ed29cba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da65d192-60f8-4e65-b11d-4773c30ceefc"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:54.628742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a6fdc8cf-5982-44b9-af97-4ec20ed29cba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:54.634618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6fdc8cf-5982-44b9-af97-4ec20ed29cba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:54.635038 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6fdc8cf-5982-44b9-af97-4ec20ed29cba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:54.636087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6fdc8cf-5982-44b9-af97-4ec20ed29cba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:54.636574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6fdc8cf-5982-44b9-af97-4ec20ed29cba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:54.697657 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:54.701026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:54.707622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:54.708055 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:54.708868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:54.709350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:54.863542 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:54.876805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d2416a87-f261-485f-9822-b9af5351beb6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.185088 Dec 24 04:59:54.880674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 84/150] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:54 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:55.010217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:55.010816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:55.017785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.018516 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.019608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.020204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.054841 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a6fdc8cf-5982-44b9-af97-4ec20ed29cba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431884 Dec 24 04:59:55.055819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 67/151] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 04:59:54 2021] POST /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:55.076115 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-40f23442-bd5b-4c04-b781-61c1736a13a9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bcef3d7-a7aa-412b-a686-15a49c4423a7"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:55.077355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-40f23442-bd5b-4c04-b781-61c1736a13a9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:55.085498 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f23442-bd5b-4c04-b781-61c1736a13a9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.085934 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f23442-bd5b-4c04-b781-61c1736a13a9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.086716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f23442-bd5b-4c04-b781-61c1736a13a9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.087138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f23442-bd5b-4c04-b781-61c1736a13a9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.191990 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:55.201847 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-777ced79-2015-497c-9c9e-089fdffbc4ed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.196246 Dec 24 04:59:55.203177 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 85/152] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:55 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 04:59:55.208107 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:55.208816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:55.215883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.216692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.217785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.218409 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.377469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:55.385096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:55.386558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:55.387628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d47cf30e-6aa7-437a-9a67-46453eb2e68d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.183321 Dec 24 04:59:55.388179 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 86/153] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:55 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:55.396279 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-dad99408-ee29-4f25-a517-253d9a3eb333 req-44238f5b-30df-4f7d-b361-c3d8197e0b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "name": "network-vif-plugged", "status": "completed", "tag": "24d08627-8243-4361-b6b4-8461a18d110f"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:55.398338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:55.398338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 04:59:55.405470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-dad99408-ee29-4f25-a517-253d9a3eb333 req-44238f5b-30df-4f7d-b361-c3d8197e0b01 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.405928 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-dad99408-ee29-4f25-a517-253d9a3eb333 req-44238f5b-30df-4f7d-b361-c3d8197e0b01 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.418655 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-dad99408-ee29-4f25-a517-253d9a3eb333 req-44238f5b-30df-4f7d-b361-c3d8197e0b01 service nova] Creating event network-vif-plugged:24d08627-8243-4361-b6b4-8461a18d110f for instance 580344bb-42e6-4fd7-967d-04e85d821fd2 on hv-cinder-81644 Dec 24 04:59:55.424472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-dad99408-ee29-4f25-a517-253d9a3eb333 req-44238f5b-30df-4f7d-b361-c3d8197e0b01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034346 Dec 24 04:59:55.424472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 87/154] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:55.787377 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-40f23442-bd5b-4c04-b781-61c1736a13a9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "POST /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.716914 Dec 24 04:59:55.787973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 68/155] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 04:59:55 2021] POST /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:55.898218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:55.898909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:55.908419 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.908905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:55.909707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:55.910141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:56.064033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:56.076679 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-da7fabfd-34f5-4658-85b0-5e1ce483328d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.182690 Dec 24 04:59:56.077261 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 88/156] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:55 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:56.230528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:56.231263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:56.238074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:56.238721 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:56.239484 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:56.240083 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:56.386960 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:56.395364 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.176725 Dec 24 04:59:56.395948 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 69/157] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:56 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:56.406344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:56.407481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:56.415875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:56.416321 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:56.417122 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:56.417547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:56.567696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:56.575941 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:56.577490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:56.578696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7a8504e2-4737-4e3f-9430-62c79dd9d26c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.176647 Dec 24 04:59:56.579566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 89/158] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:56 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 04:59:57.097753 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:57.098379 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:57.107054 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:57.107603 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:57.108561 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:57.109143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:57.251288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:57.260336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8c58790f-7641-4056-aa76-08c421831da2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.167952 Dec 24 04:59:57.260958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 70/159] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:57 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:57.411555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:57.412155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:57.418071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:57.418499 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:57.419253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:57.419677 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:57.441029 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-6a507996-ec03-4fb1-a296-4de094377145 req-572badad-152e-459f-b0bf-6f426788879d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 04:59:57.442654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:57.442654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 04:59:57.450358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-6a507996-ec03-4fb1-a296-4de094377145 req-572badad-152e-459f-b0bf-6f426788879d service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:57.450725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-6a507996-ec03-4fb1-a296-4de094377145 req-572badad-152e-459f-b0bf-6f426788879d service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:57.462709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-6a507996-ec03-4fb1-a296-4de094377145 req-572badad-152e-459f-b0bf-6f426788879d service nova] Creating event network-vif-plugged:61ec3441-5b75-4c07-b8ad-4174450d6a55 for instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 on hv-cinder-81644 Dec 24 04:59:57.469327 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-6a507996-ec03-4fb1-a296-4de094377145 req-572badad-152e-459f-b0bf-6f426788879d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034500 Dec 24 04:59:57.470154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 71/160] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 04:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 04:59:57.570219 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:57.579880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f448df60-7870-4be4-a02d-5ab1653ab3be tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.171812 Dec 24 04:59:57.588625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 90/161] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:57 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:57.597678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:57.598618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:57.605099 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:57.605505 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:57.606263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:57.606685 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:57.743009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:57.751527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:57.753032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:57.754118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.160878 Dec 24 04:59:57.754679 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 72/162] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:57 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:58.281779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:58.282171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:58.288585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:58.289050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:58.289784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:58.290232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:58.430614 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:58.438528 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1441e8ea-bf83-4639-bab9-3b13e869949a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.163531 Dec 24 04:59:58.439094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 91/163] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:58 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:58.600243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:58.600913 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:58.607502 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:58.607945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:58.608783 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:58.609207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:58.747022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:58.754438 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.158288 Dec 24 04:59:58.754969 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 73/164] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:58 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:58.778078 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:58.778808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:58.785339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:58.785776 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:58.786531 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:58.786960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:58.931788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:58.939757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:58.941283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:58.942359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a8dd88ed-a44b-45a3-86bd-4209258c2036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.167956 Dec 24 04:59:58.942928 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 92/165] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:58 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 04:59:59.464577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:59.465486 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:59.475818 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:59.476689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:59.477991 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:59.478712 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:59.625893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:59.633669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.175613 Dec 24 04:59:59.634234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 74/166] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:59 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:59.771272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:59.771880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:59.778189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:59.778631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:59.779397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:59.779819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:59.923018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 04:59:59.930316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.162830 Dec 24 04:59:59.930875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 93/167] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 04:59:59 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 04:59:59.960909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 04:59:59.961502 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 04:59:59.967840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:59.968278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:59:59.969245 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:59:59.969601 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:00.110751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:00.118507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:00.120027 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:00.121151 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.164381 Dec 24 05:00:00.121713 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 75/168] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 04:59:59 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:00.655108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:00.656027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:00.663053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:00.663496 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:00.664253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:00.664705 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:00.798312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:00.806334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ef888909-57aa-4b54-bfb2-b1bd729e579b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.157147 Dec 24 05:00:00.806901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 94/169] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:00 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:00.947191 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:00.947786 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:00.954720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:00.955155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:00.955986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:00.956439 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:01.106731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:01.117005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.173384 Dec 24 05:00:01.121746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 76/170] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:00 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:01.139930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:01.141027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:01.147135 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:01.147599 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:01.149309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:01.149765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:01.287223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:01.295112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:01.296669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:01.298007 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-876a5d48-cce1-4718-ae5c-e4be7a1c261f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.162242 Dec 24 05:00:01.298521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 95/171] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:01 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:01.826044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:01.826966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:01.834143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:01.834585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:01.835668 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:01.836097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:01.973357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:01.980889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c5531ca9-c3d6-429e-8686-4ec6af302e98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.160582 Dec 24 05:00:01.981454 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 77/172] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:01 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:02.137396 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:02.138245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:02.148603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:02.149385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:02.150656 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:02.151372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:02.287857 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:02.298254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ed82e480-8d64-427b-8409-abea9c2c8e0f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.166834 Dec 24 05:00:02.298951 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 96/173] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:02 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:02.317207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:02.317811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:02.323941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:02.324398 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:02.325181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:02.325613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:02.464334 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:02.473362 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:02.474842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:02.475975 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.163200 Dec 24 05:00:02.476519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 78/174] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:02 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:02.998348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:02.999285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:03.005753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:03.006322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:03.007154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:03.007603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:03.148281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:03.158501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a46ef2ab-cf18-4326-b95e-6e77857d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.164052 Dec 24 05:00:03.162352 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 97/175] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:02 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:03.318102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:03.318711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:03.325459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:03.325886 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:03.326665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:03.327094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:03.470551 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:03.478272 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-73ff3481-33a5-4198-b2ab-75b2b384929f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.164370 Dec 24 05:00:03.480935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 79/176] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:03 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:03.494166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:03.495024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:03.501804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:03.502222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:03.502991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:03.503411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:03.642214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:03.650368 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:03.651822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:03.652932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-55579b70-fb36-47df-9340-9ec5f6ada691 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.162430 Dec 24 05:00:03.653486 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 98/177] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:03 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:04.177667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:04.178267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:04.184826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:04.185274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:04.186048 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:04.186477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:04.324215 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:04.332122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-71d5d931-c2ce-427e-8758-a1aedbf12495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.158104 Dec 24 05:00:04.332704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 80/178] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:04 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:04.498365 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:04.498937 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:04.505667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:04.506103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:04.506859 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:04.507278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:04.652764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:04.660645 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0fb8a432-446a-4b2f-a44e-8fdd75438179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.168210 Dec 24 05:00:04.661199 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 99/179] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:04 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:04.671738 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:04.672375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:04.678303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:04.678772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:04.679588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:04.680037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:04.820963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:04.829262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:04.830732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:04.831788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b98b685e-6ddd-4057-bff0-a776a2048d67 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.164042 Dec 24 05:00:04.832375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 81/180] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:04 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:00:05.351508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:05.352407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:05.360007 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:05.360479 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:05.361376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:05.363887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:05.504668 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:05.512013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae20ea90-5e07-43a5-9907-6265b8918357 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.165506 Dec 24 05:00:05.512560 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 100/181] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:05 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:05.680541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:05.681217 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:05.688988 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:05.689449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:05.690231 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:05.690695 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:05.824579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:05.836689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9466fc0b-a961-41c0-83dc-f1776c0a3030 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.162184 Dec 24 05:00:05.837567 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 82/182] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:05 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:05.850047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:05.850642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:05.856699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:05.857144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:05.857917 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:05.858318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:06.003076 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:06.014098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:06.016677 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:06.018309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-18ae270d-27e6-473e-9270-49a22efdf410 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.171766 Dec 24 05:00:06.019050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 101/183] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:05 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:06.532403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:06.533049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:06.539423 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:06.539862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:06.540661 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:06.541088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:06.686344 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:06.693778 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e961ad51-c93a-4312-b443-2fca4b7012f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.166935 Dec 24 05:00:06.694348 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 83/184] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:06 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:06.860930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:06.861930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:06.872148 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:06.872917 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:06.874166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:06.874990 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:07.018904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:07.026852 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-28e238ec-be08-4533-8b8a-487fbabcbe9f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.172491 Dec 24 05:00:07.027378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 102/185] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:06 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:07.040785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:07.041584 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:07.048578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:07.049033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:07.049880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:07.050312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:07.186599 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:07.198388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:07.199873 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:07.200998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.164095 Dec 24 05:00:07.201563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 84/186] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:07 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:07.714888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:07.715867 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:07.727050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:07.727745 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:07.729066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:07.729769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:07.862674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:07.870708 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.162174 Dec 24 05:00:07.871237 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 103/187] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:07 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:08.048107 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:08.049028 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:08.059322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:08.060038 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:08.061345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:08.062263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:08.201812 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:08.211714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bd8a11e2-a971-4f23-a41c-e2be3a240337 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.169871 Dec 24 05:00:08.212283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 85/188] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:08 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:08.219183 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:08.219894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:08.226678 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:08.227122 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:08.227889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:08.228314 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:08.372435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:08.381012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:08.382478 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:08.383559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6292e436-2b6e-4a45-9536-383df2b6cb5a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.168217 Dec 24 05:00:08.384108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 104/189] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:08 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:08.886884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:08.887480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:08.894060 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:08.894500 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:08.895265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:08.895689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:09.035909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:09.043247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4432d3c6-5334-42c7-99a1-caaea6dab386 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.159987 Dec 24 05:00:09.043811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 86/190] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:08 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:09.232507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:09.233457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:09.240551 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:09.241034 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:09.241791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:09.242212 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:09.387458 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:09.395741 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.169577 Dec 24 05:00:09.396772 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 105/191] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:09 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:09.401700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:09.402857 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:09.409410 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:09.409848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:09.410615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:09.411033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:09.550053 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:09.557886 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:09.559341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:09.560764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-85c379af-05ac-49fc-8455-d5e6f9394bf4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.162707 Dec 24 05:00:09.561385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 87/192] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:09 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:10.061679 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:10.062731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:10.071198 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:10.071791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:10.072854 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:10.073429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:10.222484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:10.230555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1320 microversion: 2.1 time: 0.173686 Dec 24 05:00:10.231117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 106/193] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:10 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:10.416648 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:10.417697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:10.428400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:10.429195 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:10.430528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:10.431279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:10.570247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:10.577467 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.167007 Dec 24 05:00:10.578276 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 88/194] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:10 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:10.580420 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:10.580889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:10.587711 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:10.588225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:10.589132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:10.589595 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:10.744063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:10.752832 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:10.754615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:10.755693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6d330bed-6664-4677-a0a1-40cb0301b7ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.180367 Dec 24 05:00:10.756245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 107/195] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:10 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:11.249998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:11.250485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:11.257416 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.257853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.258661 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.259083 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.392067 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:11.401590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1514 microversion: 2.1 time: 0.156697 Dec 24 05:00:11.402155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 89/196] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:11 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:11.425366 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:11.426362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:11.432590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.433042 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.433789 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.434209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.495115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lazy-loading 'flavor' on Instance uuid 580344bb-42e6-4fd7-967d-04e85d821fd2 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:00:11.595585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:11.596855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:11.603407 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.603844 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.604710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.605137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.611832 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-01a82663-f70b-421c-9875-723ab30b7fc3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2/action" status: 200 len: 32 microversion: 2.1 time: 0.190428 Dec 24 05:00:11.616066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 108/197] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:00:11 2021] POST /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:00:11.622376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:11.623793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:11.632836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.633301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.634178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.634604 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.794785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:11.803668 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-60282809-c155-4ef4-a47e-368182c6ad2b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.212193 Dec 24 05:00:11.804259 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 90/198] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:11 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:11.816577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:11.817288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:11.831151 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.831656 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.832431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:11.832946 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:11.836995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:11.845965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4834dad5-ccf1-4888-b524-96cd3ff992a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.228007 Dec 24 05:00:11.847431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 109/199] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:11 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:12.047556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:12.055691 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:12.057247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:12.058379 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1406 microversion: 2.20 time: 0.247647 Dec 24 05:00:12.058966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 91/200] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:11 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:12.820138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:12.820761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:12.826774 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:12.827218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:12.828164 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:12.828633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:12.865701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:12.866307 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:12.872854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:12.873290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:12.874059 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:12.874479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:12.965564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:12.980338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d07dba6a-bc47-4703-9017-00ea58c19a30 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.163635 Dec 24 05:00:12.980964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 110/201] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:12 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:13.057830 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:13.067626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-08f92b31-2122-4f57-87ed-45f4a6aef036 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.205223 Dec 24 05:00:13.078885 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 92/202] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:12 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:13.079202 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:13.079202 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:13.086555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:13.087229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:13.088202 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:13.088808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:13.238066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:13.245919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:13.247362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:13.248477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1597 microversion: 2.20 time: 0.175920 Dec 24 05:00:13.249236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 111/203] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:00:13 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1597 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:00:13.266756 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-85f84946-09ae-4038-92d8-106f46a927b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:13.267243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-85f84946-09ae-4038-92d8-106f46a927b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:13.272904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85f84946-09ae-4038-92d8-106f46a927b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:13.273345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85f84946-09ae-4038-92d8-106f46a927b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:13.274109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85f84946-09ae-4038-92d8-106f46a927b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:13.274527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-85f84946-09ae-4038-92d8-106f46a927b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:13.363696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-85f84946-09ae-4038-92d8-106f46a927b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100485 Dec 24 05:00:13.364565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 93/204] 10.222.0.43 () {60 vars in 1315 bytes} [Fri Dec 24 05:00:13 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:00:14.002483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:14.003300 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:14.010044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:14.010500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:14.011268 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:14.011687 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:14.088185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:14.089268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:14.097590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:14.098323 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:14.098879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:14.105491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:14.201356 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:14.210607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2b85b9f6-4548-4257-a653-a01229b38583 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.212586 Dec 24 05:00:14.220003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 112/205] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:13 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:14.540315 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:14.548183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0c9c897e-f6cf-47c7-9429-6331608298e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.465492 Dec 24 05:00:14.548788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 94/206] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:14 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:14.825294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aa7d9d91-98f4-4845-89ab-68b1be551f9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:14.826345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-aa7d9d91-98f4-4845-89ab-68b1be551f9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:14.833087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-9eb07324-4929-4ce3-a62c-04f2edc630e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:14.835383 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:14.835383 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:00:14.852769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7d9d91-98f4-4845-89ab-68b1be551f9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:14.854208 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7d9d91-98f4-4845-89ab-68b1be551f9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:14.854335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-9eb07324-4929-4ce3-a62c-04f2edc630e8 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:14.855233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-9eb07324-4929-4ce3-a62c-04f2edc630e8 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:14.855819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7d9d91-98f4-4845-89ab-68b1be551f9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:14.856505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa7d9d91-98f4-4845-89ab-68b1be551f9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:14.869227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-9eb07324-4929-4ce3-a62c-04f2edc630e8 service nova] Creating event network-changed:61ec3441-5b75-4c07-b8ad-4174450d6a55 for instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 on hv-cinder-81644 Dec 24 05:00:14.876686 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-9eb07324-4929-4ce3-a62c-04f2edc630e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046930 Dec 24 05:00:14.877311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 95/207] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:15.011319 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aa7d9d91-98f4-4845-89ab-68b1be551f9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.190046 Dec 24 05:00:15.015605 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 113/208] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:14 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:15.227969 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:15.228695 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:15.236970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:15.237637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:15.238556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:15.239185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:15.471789 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:15.486421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.261363 Dec 24 05:00:15.497375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 96/209] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:15 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:15.567253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:15.568020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:15.577242 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:15.577848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:15.578631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:15.579057 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:15.738220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:15.747886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.184680 Dec 24 05:00:15.748461 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 114/210] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:15 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:16.024840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-266817db-d1a0-4759-adfd-606d60c1a0ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:16.025799 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-266817db-d1a0-4759-adfd-606d60c1a0ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:16.032311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-266817db-d1a0-4759-adfd-606d60c1a0ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:16.032776 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-266817db-d1a0-4759-adfd-606d60c1a0ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:16.033555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-266817db-d1a0-4759-adfd-606d60c1a0ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:16.034018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-266817db-d1a0-4759-adfd-606d60c1a0ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:16.164687 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-266817db-d1a0-4759-adfd-606d60c1a0ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.144910 Dec 24 05:00:16.165610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 97/211] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:16 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:16.406271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-4202da97-28f5-4590-bde5-c8bcda08ea8d req-3000d2dc-f2ae-4cac-97f2-09446645de61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "name": "network-vif-plugged", "status": "completed", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:16.408226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:16.408226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:00:16.417020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4202da97-28f5-4590-bde5-c8bcda08ea8d req-3000d2dc-f2ae-4cac-97f2-09446645de61 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:16.417842 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4202da97-28f5-4590-bde5-c8bcda08ea8d req-3000d2dc-f2ae-4cac-97f2-09446645de61 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:16.431966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-4202da97-28f5-4590-bde5-c8bcda08ea8d req-3000d2dc-f2ae-4cac-97f2-09446645de61 service nova] Creating event network-vif-plugged:95dbce62-23b4-409c-85a9-e1a32a7eb1bb for instance 1f2eb78b-9eeb-4011-b480-333a74a448a7 on hv-cinder-81644 Dec 24 05:00:16.437476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-4202da97-28f5-4590-bde5-c8bcda08ea8d req-3000d2dc-f2ae-4cac-97f2-09446645de61 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035573 Dec 24 05:00:16.438163 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 115/212] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:16.504422 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:16.505154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:16.512115 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:16.512580 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:16.513369 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:16.513789 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:16.765870 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:16.767289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:16.776485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:16.777282 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:16.779956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:16.780573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:16.789992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:16.813762 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.313415 Dec 24 05:00:16.814357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 98/213] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:16 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:16.950721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:16.959382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7612dff6-a3db-4ccb-a28b-216886ec1d13 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.198609 Dec 24 05:00:16.961412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 116/214] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:16 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:17.176986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4994752f-cd9e-4276-bd38-aaa45bcd1dc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:17.181274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4994752f-cd9e-4276-bd38-aaa45bcd1dc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:17.188410 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4994752f-cd9e-4276-bd38-aaa45bcd1dc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:17.188915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4994752f-cd9e-4276-bd38-aaa45bcd1dc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:17.189804 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4994752f-cd9e-4276-bd38-aaa45bcd1dc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:17.190258 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4994752f-cd9e-4276-bd38-aaa45bcd1dc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:17.531241 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4994752f-cd9e-4276-bd38-aaa45bcd1dc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.359303 Dec 24 05:00:17.532261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 99/215] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:17 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:17.830763 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:17.831379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:17.838398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:17.838839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:17.839641 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:17.840017 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:17.978748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:17.979443 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:17.980686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:17.986660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:17.987108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:17.987873 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:17.988346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:17.989184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e232e061-47ea-4e91-8863-894703c5d687 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.162150 Dec 24 05:00:17.989838 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 117/216] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:17 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:18.126151 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:18.133519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.159383 Dec 24 05:00:18.134108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 100/217] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:17 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:18.542874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fb569db6-1483-4966-9024-ff5f73ebf720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:18.543935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fb569db6-1483-4966-9024-ff5f73ebf720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:18.550451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb569db6-1483-4966-9024-ff5f73ebf720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:18.550906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb569db6-1483-4966-9024-ff5f73ebf720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:18.551702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb569db6-1483-4966-9024-ff5f73ebf720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:18.552140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb569db6-1483-4966-9024-ff5f73ebf720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:18.978506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fb569db6-1483-4966-9024-ff5f73ebf720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.438849 Dec 24 05:00:18.979442 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 118/218] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:18 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:19.005851 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:19.006463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:19.013279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:19.013725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:19.014362 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:19.014781 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:19.150329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:19.151513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:19.152200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:19.160097 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:19.160555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:19.161343 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:19.161758 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:19.162743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3eec8cad-4663-43c6-8d48-09efff7f2da3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1314 microversion: 2.1 time: 0.160436 Dec 24 05:00:19.163698 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 101/219] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:19 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:19.311654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:19.317633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-90c2c708-496a-4e7e-87b7-213d56126b08 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.170138 Dec 24 05:00:19.326993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 119/220] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:19 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:19.991805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a018d908-beda-441b-8bec-42fdf34a77a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:19.992848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a018d908-beda-441b-8bec-42fdf34a77a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:19.999468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a018d908-beda-441b-8bec-42fdf34a77a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:20.000124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a018d908-beda-441b-8bec-42fdf34a77a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:20.000937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a018d908-beda-441b-8bec-42fdf34a77a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:20.001356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a018d908-beda-441b-8bec-42fdf34a77a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:20.184786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:20.185589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:20.193270 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:20.193711 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:20.194455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:20.194876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:20.333400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:20.341397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9d7f7195-990d-4838-9d71-fca7b5015465 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1498 microversion: 2.1 time: 0.162887 Dec 24 05:00:20.341930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 120/221] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:20 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:20.346180 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:20.346768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:20.352383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:20.352862 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:20.353628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:20.354051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:20.483106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:20.491019 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ff2d2107-c705-42ad-87fd-8d0989555154 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.148163 Dec 24 05:00:20.491574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 121/222] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:20 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:20.738847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a018d908-beda-441b-8bec-42fdf34a77a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.750746 Dec 24 05:00:20.742927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 102/223] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:19 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:20.775196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-428087493", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "b92a87f3-957a-4ccb-9b5b-98ad92aebe6e"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:20.832014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] validate_networks() for [('b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:00:21.371970 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:00:21.372566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:00:21.372824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:00:21.373301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:00:21.373703 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:00:21.385400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:21.386220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:21.387595 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:21.388206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:21.405561 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:00:21.409492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for user f29f576d3a98449b8077c0df53968f07 and project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:00:21.421213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:00:21.423476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:00:21.472283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-828559b5-f1af-418e-8517-4d6fb1e5bbfd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700692 Dec 24 05:00:21.473172 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 122/224] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:00:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:00:21.483356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3408ae27-bae7-4c67-a97b-2b54301c198b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:21.484487 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3408ae27-bae7-4c67-a97b-2b54301c198b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:21.512442 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:21.513189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:21.520869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:21.520869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:21.521800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:21.522322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:21.545202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3408ae27-bae7-4c67-a97b-2b54301c198b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:21.552757 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3408ae27-bae7-4c67-a97b-2b54301c198b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1217 microversion: 2.1 time: 0.073118 Dec 24 05:00:21.553184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 103/225] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:21 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:21.659447 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:21.666813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b00cfe4c-e343-4141-b344-ba0627644052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.158279 Dec 24 05:00:21.667643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 123/226] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:21 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:21.750556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-58b18fd7-60df-4d30-92c7-48409afcbd98 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:21.751736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-58b18fd7-60df-4d30-92c7-48409afcbd98 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:21.758716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-58b18fd7-60df-4d30-92c7-48409afcbd98 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:21.759153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-58b18fd7-60df-4d30-92c7-48409afcbd98 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:21.759967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-58b18fd7-60df-4d30-92c7-48409afcbd98 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:21.760388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-58b18fd7-60df-4d30-92c7-48409afcbd98 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:22.573096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:22.574187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:22.586051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:22.586759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:22.588073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:22.588834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:22.652237 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:22.663752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eb361913-8779-4251-980d-0c0b6f9a0f13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1221 microversion: 2.1 time: 0.096537 Dec 24 05:00:22.664628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 124/227] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:22 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:22.684121 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:22.684755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:22.690657 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:22.691094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:22.691837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:22.692252 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:22.831999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:22.839959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.159155 Dec 24 05:00:22.840518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 125/228] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:22 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:23.687281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:23.688499 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:23.698680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:23.699401 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:23.700690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:23.701388 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:23.762039 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:23.769498 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1221 microversion: 2.1 time: 0.088695 Dec 24 05:00:23.770053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 126/229] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:23 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:23.864187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:23.865173 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:23.875001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:23.875438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:23.876226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:23.876669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:24.018406 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:24.025948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.167774 Dec 24 05:00:24.026482 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 127/230] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:23 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:24.786942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:24.787546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:24.795130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:24.795622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:24.796494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:24.797119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:24.864618 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:24.872507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a412f79d-0113-4847-b3d4-4fdf053d2fbe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1221 microversion: 2.1 time: 0.089775 Dec 24 05:00:24.873069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 128/231] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:24 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:25.047652 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:25.048202 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:25.054834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:25.055296 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:25.056091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:25.056559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:25.187841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:25.196192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0c58fc56-b028-429e-9606-0360f92330ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.154197 Dec 24 05:00:25.197028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 129/232] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:25 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:25.889364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:25.890337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:25.897027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:25.897463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:25.898217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:25.898638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:25.958231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:25.973649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-850abbeb-c32e-4104-9190-b20e67577f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1221 microversion: 2.1 time: 0.087542 Dec 24 05:00:25.974433 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 130/233] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:25 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:26.217769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:26.218571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:26.225029 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:26.225905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:26.226214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:26.226664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:26.341237 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-58b18fd7-60df-4d30-92c7-48409afcbd98 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 4.594568 Dec 24 05:00:26.341929 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 104/234] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:21 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 4596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:26.387196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:26.394778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-427a211e-9f37-41d1-b523-ab95fbefd920 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.183190 Dec 24 05:00:26.395328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 131/235] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:26 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:26.998072 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:26.998765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:27.006729 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.007173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.007938 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.008363 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.075414 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:27.083037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ff99a34c-525e-4fcc-affb-5a91c3458fcc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1269 microversion: 2.1 time: 0.089005 Dec 24 05:00:27.083562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 105/236] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:26 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:27.351981 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-680468d0-15ce-403e-8d5d-5c58e4614aa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:27.353428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-680468d0-15ce-403e-8d5d-5c58e4614aa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:27.360563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-680468d0-15ce-403e-8d5d-5c58e4614aa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.361003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-680468d0-15ce-403e-8d5d-5c58e4614aa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.361778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-680468d0-15ce-403e-8d5d-5c58e4614aa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.362209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-680468d0-15ce-403e-8d5d-5c58e4614aa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.402639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:27.403165 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:27.409995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.410512 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.411441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.411912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.438285 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:00:27.528837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-680468d0-15ce-403e-8d5d-5c58e4614aa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.179998 Dec 24 05:00:27.534064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 132/237] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:27 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:27.540914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:27.542402 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:27.552153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.553124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.554432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.555122 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.555888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 204 len: 0 microversion: 2.1 time: 0.156684 Dec 24 05:00:27.556805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 106/238] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:00:27 2021] DELETE /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:00:27.565877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:27.566663 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:27.574145 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.574853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.575927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:27.576493 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:27.703114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:27.711677 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4d182dde-c84b-48ce-ae59-66d3de76a840 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.175811 Dec 24 05:00:27.712616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 133/239] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:27 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:27.724338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:27.737660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1504 microversion: 2.1 time: 0.176351 Dec 24 05:00:27.738992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 107/240] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:27 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:28.105004 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:28.106446 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:28.119534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.122830 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.125052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.125818 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.227991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:28.236383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3942f171-625b-472d-9123-768ad081933c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1275 microversion: 2.1 time: 0.139812 Dec 24 05:00:28.238020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 134/241] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:28 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:28.549954 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4cbda49a-5154-49fe-87eb-7d28c3f8c580 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:28.555159 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4cbda49a-5154-49fe-87eb-7d28c3f8c580 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:28.580139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cbda49a-5154-49fe-87eb-7d28c3f8c580 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.580772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cbda49a-5154-49fe-87eb-7d28c3f8c580 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.582804 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cbda49a-5154-49fe-87eb-7d28c3f8c580 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.585056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cbda49a-5154-49fe-87eb-7d28c3f8c580 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.730573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:28.731535 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:28.742108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4cbda49a-5154-49fe-87eb-7d28c3f8c580 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.204197 Dec 24 05:00:28.743364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.744164 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.745559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.746233 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.747184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 108/242] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:28 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:28.755578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:28.756605 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:28.764688 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.765545 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.766548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:28.767321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:28.946222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:28.960634 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bdc82ce6-75d0-4683-a092-1e27d90076f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.235647 Dec 24 05:00:28.961380 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 135/243] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:28 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:29.073332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:29.080877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4c0c82c8-75bf-41cb-b992-187d335e3975 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1504 microversion: 2.1 time: 0.329238 Dec 24 05:00:29.081449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 109/244] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:28 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:29.255205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:29.255790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:29.262587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:29.263024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:29.263808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:29.264212 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:29.411266 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:29.419723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3da170ea-6d71-4002-9504-30cf14611dfb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.168088 Dec 24 05:00:29.420375 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 136/245] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:29 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:29.754643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b7c737de-4474-452c-b3a8-8e5af5e0fde2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:29.756130 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-144e42ad-dee5-477b-bdb7-dd635438ba70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:29.758647 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:29.758647 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:00:29.764099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b7c737de-4474-452c-b3a8-8e5af5e0fde2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:29.774396 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7c737de-4474-452c-b3a8-8e5af5e0fde2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:29.774893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7c737de-4474-452c-b3a8-8e5af5e0fde2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:29.775695 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7c737de-4474-452c-b3a8-8e5af5e0fde2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:29.777391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b7c737de-4474-452c-b3a8-8e5af5e0fde2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:29.779199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-144e42ad-dee5-477b-bdb7-dd635438ba70 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:29.780137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-144e42ad-dee5-477b-bdb7-dd635438ba70 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:29.791341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-144e42ad-dee5-477b-bdb7-dd635438ba70 service nova] Creating event network-changed:b0bd939a-1211-4ec1-b074-b2767d087f95 for instance cccacaaf-be31-4169-8a5b-13ea806dbd2c on hv-cinder-81644 Dec 24 05:00:29.797252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-144e42ad-dee5-477b-bdb7-dd635438ba70 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046134 Dec 24 05:00:29.798341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 110/246] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:29.944974 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b7c737de-4474-452c-b3a8-8e5af5e0fde2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.193694 Dec 24 05:00:29.946150 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 137/247] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:29 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:29.980148 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:29.981112 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:29.989908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:29.990519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:29.991676 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:29.992571 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:30.099154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:30.099764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:30.107435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:30.108085 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:30.109923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:30.110502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:30.239459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:30.247062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.272868 Dec 24 05:00:30.253986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 111/248] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:29 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:30.286024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:30.293714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1504 microversion: 2.1 time: 0.198522 Dec 24 05:00:30.296647 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 138/249] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:30 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:30.437301 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:30.438010 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:30.444134 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:30.444598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:30.445611 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:30.445790 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:30.616547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:30.623951 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8bcc1d8b-5325-421b-980d-1b58e87153a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.190795 Dec 24 05:00:30.625004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 112/250] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:30 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:30.958552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5723ee1c-f1fc-44dd-945c-4c7303673537 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:30.960905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5723ee1c-f1fc-44dd-945c-4c7303673537 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:30.970611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5723ee1c-f1fc-44dd-945c-4c7303673537 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:30.971045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5723ee1c-f1fc-44dd-945c-4c7303673537 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:30.971978 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5723ee1c-f1fc-44dd-945c-4c7303673537 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:30.972232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5723ee1c-f1fc-44dd-945c-4c7303673537 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:31.077289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5723ee1c-f1fc-44dd-945c-4c7303673537 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.124105 Dec 24 05:00:31.079228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 139/251] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:30 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:31.264766 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:31.265537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:31.272726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:31.272726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:31.273176 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:31.273605 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:31.312655 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:31.313636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:31.322297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:31.322794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:31.324367 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:31.324975 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:31.444211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:31.454545 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-683e32df-d724-4ee6-8c43-f9fb7d007429 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.193045 Dec 24 05:00:31.455232 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 113/252] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:31 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:31.484080 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:31.492565 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1504 microversion: 2.1 time: 0.184782 Dec 24 05:00:31.493471 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 140/253] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:31 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:31.644343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:31.645010 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:31.651218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:31.651661 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:31.652677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:31.653250 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:31.907381 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:31.915838 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a679b569-9c45-4fb5-b499-2346b18029e9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.278603 Dec 24 05:00:31.916833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 114/254] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:31 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:32.090415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e8dcb47f-706a-43ec-8ac7-d7aa2d69ec0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:32.091992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e8dcb47f-706a-43ec-8ac7-d7aa2d69ec0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:32.099343 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8dcb47f-706a-43ec-8ac7-d7aa2d69ec0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.100256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8dcb47f-706a-43ec-8ac7-d7aa2d69ec0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.101416 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8dcb47f-706a-43ec-8ac7-d7aa2d69ec0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.102064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8dcb47f-706a-43ec-8ac7-d7aa2d69ec0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.237354 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e8dcb47f-706a-43ec-8ac7-d7aa2d69ec0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.151056 Dec 24 05:00:32.241027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 141/255] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:32 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:32.268216 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-77dc92a6-91cd-440b-b127-5d4bda52ffdc req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "name": "network-vif-deleted", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:32.270556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:32.270556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:00:32.278359 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-77dc92a6-91cd-440b-b127-5d4bda52ffdc req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.278814 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-77dc92a6-91cd-440b-b127-5d4bda52ffdc req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.290163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-77dc92a6-91cd-440b-b127-5d4bda52ffdc req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 service nova] Creating event network-vif-deleted:95dbce62-23b4-409c-85a9-e1a32a7eb1bb for instance 1f2eb78b-9eeb-4011-b480-333a74a448a7 on hv-cinder-81644 Dec 24 05:00:32.295360 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-77dc92a6-91cd-440b-b127-5d4bda52ffdc req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031027 Dec 24 05:00:32.295934 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 115/256] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:32.471638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:32.472325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:32.479341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.480138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.480584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.481013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.510456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:32.511164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:32.518761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.519418 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.520251 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.520717 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.559428 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.560169 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.560868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lazy-loading 'fault' on Instance uuid 1f2eb78b-9eeb-4011-b480-333a74a448a7 {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:00:32.609724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:32.617213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bc92ebc1-02c1-4e80-b103-0c377013c868 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 200 len: 1304 microversion: 2.1 time: 0.110817 Dec 24 05:00:32.617794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 116/257] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:32 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:32.660051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:32.667669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-23952dc0-8540-4444-a30d-b6c5003df463 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.200163 Dec 24 05:00:32.668232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 142/258] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:32 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:32.935915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:32.936915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:32.945784 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.946898 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:32.948346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:32.949452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:33.105732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:33.113366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-919da9d9-c5db-4dba-9c9e-e05868c52012 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.184636 Dec 24 05:00:33.113937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 117/259] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:32 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:33.248392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-de8bb8ef-8ab2-4a39-8db6-ab87d0779d77 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:33.249429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-de8bb8ef-8ab2-4a39-8db6-ab87d0779d77 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:33.256643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de8bb8ef-8ab2-4a39-8db6-ab87d0779d77 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:33.257558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de8bb8ef-8ab2-4a39-8db6-ab87d0779d77 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:33.258514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de8bb8ef-8ab2-4a39-8db6-ab87d0779d77 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:33.259091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de8bb8ef-8ab2-4a39-8db6-ab87d0779d77 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:33.538749 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-de8bb8ef-8ab2-4a39-8db6-ab87d0779d77 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 14 microversion: 2.20 time: 0.294181 Dec 24 05:00:33.539552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 143/260] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:33 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 14 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:33.634173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:33.635314 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: 1f2eb78b-9eeb-4011-b480-333a74a448a7] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:33.642214 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:33.642979 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:33.643911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:33.644614 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:33.658534 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] HTTP exception thrown: Instance 1f2eb78b-9eeb-4011-b480-333a74a448a7 could not be found. Dec 24 05:00:33.659385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Returning 404 to user: Instance 1f2eb78b-9eeb-4011-b480-333a74a448a7 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:00:33.660242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6192496b-1602-4a23-bbe7-fd5998722579 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7" status: 404 len: 111 microversion: 2.1 time: 0.029931 Dec 24 05:00:33.663918 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 118/261] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:33 2021] GET /compute/v2.1/servers/1f2eb78b-9eeb-4011-b480-333a74a448a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:00:33.685446 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:33.686382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:33.694533 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:33.694969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:33.695797 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:33.696216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:33.771134 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-256309823", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "c2c27570-f2cd-4dac-9473-e82a4e432501"}]}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:33.826010 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] validate_networks() for [('c2c27570-f2cd-4dac-9473-e82a4e432501', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:00:33.839074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:33.849007 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.167339 Dec 24 05:00:33.850069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 144/262] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:33 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:34.130258 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:34.131100 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:34.138584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.139019 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:34.139912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.140336 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:34.204727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:00:34.205405 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:00:34.205639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:00:34.206037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:00:34.206434 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:00:34.216997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.217428 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:34.218453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.218866 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:34.242709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Getting quotas for project 1e014b3683d841968563e0aa0705e862. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:00:34.248874 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Getting quotas for user fbefbd7e98c94b7598f4af35532d60cb and project 1e014b3683d841968563e0aa0705e862. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:00:34.263795 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:00:34.266466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:00:34.322360 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2526d385-dd29-4370-94e5-20f9469bf933 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554832 Dec 24 05:00:34.323046 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 119/263] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:00:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 24 05:00:34.333189 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2966df46-2ecf-4b10-9d94-b0f2027dcb1e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:34.333887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2966df46-2ecf-4b10-9d94-b0f2027dcb1e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:34.335973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:34.344802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-07557151-aea1-4a36-9a00-a6329ccb8561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.217960 Dec 24 05:00:34.345377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 145/264] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:34 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:34.407498 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2966df46-2ecf-4b10-9d94-b0f2027dcb1e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:34.418223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2966df46-2ecf-4b10-9d94-b0f2027dcb1e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1213 microversion: 2.1 time: 0.088784 Dec 24 05:00:34.419281 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 120/265] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:34 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:34.549463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f165b6b6-ef1c-42d6-bbc8-35518ddca93d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:34.550525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f165b6b6-ef1c-42d6-bbc8-35518ddca93d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:34.563396 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f165b6b6-ef1c-42d6-bbc8-35518ddca93d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.564813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f165b6b6-ef1c-42d6-bbc8-35518ddca93d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:34.566070 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f165b6b6-ef1c-42d6-bbc8-35518ddca93d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.567176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f165b6b6-ef1c-42d6-bbc8-35518ddca93d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:34.867129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:34.867671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:34.874626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.875061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:34.875833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:34.876262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.068794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:35.077573 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-206678eb-6fbf-41b7-8495-71018a7d9439 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.214027 Dec 24 05:00:35.087117 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 121/266] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:34 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:35.361131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:35.361733 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:35.367820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.368273 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.369077 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.369506 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.561466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:35.571152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1f5d0af7-a3a6-468e-83c5-420623d1e391 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.213143 Dec 24 05:00:35.571825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 122/267] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:35 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:35.581358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:35.582596 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:35.595446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.595965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.596997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.597491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.676029 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:35.686404 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9acd05bd-5f35-452b-b635-5e12c1c74c6e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1217 microversion: 2.1 time: 0.112728 Dec 24 05:00:35.687413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 123/268] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:35 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:35.693474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:35.693961 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:35.699949 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.700588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.701356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.701938 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.728388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:00:35.815925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-29674495-0ad5-41d1-a961-d7410c83adc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 204 len: 0 microversion: 2.1 time: 0.125693 Dec 24 05:00:35.819762 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 124/269] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:00:35 2021] DELETE /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:00:35.824495 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:35.825236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:35.830868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.831425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.832555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:35.833001 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:35.969623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:35.977326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ce7df296-34ae-403e-9803-6fa80e4657ea tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.156558 Dec 24 05:00:35.977895 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 125/270] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:35 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:36.094945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:36.095541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:36.101364 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:36.101821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:36.102595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:36.103011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:36.386836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:36.394333 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ea7b1992-f81f-4da6-a8ad-99884d53938a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.303269 Dec 24 05:00:36.394923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 126/271] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:36 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:36.596802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:36.597405 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:36.603171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:36.603604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:36.604358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:36.604802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:36.739899 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:36.747166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-484e9ea9-4cdc-4f93-9218-d557b413725d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.154542 Dec 24 05:00:36.748196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 127/272] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:36 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:36.754665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:36.755528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:36.762252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:36.762935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:36.763963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:36.764722 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:36.832709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:36.840207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-697c24e5-2bdd-49fb-9947-af5efca079af tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1217 microversion: 2.1 time: 0.090682 Dec 24 05:00:36.840825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 128/273] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:36 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:36.994733 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:36.995340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:37.002226 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.002666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.003483 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.003914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.136309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:37.144427 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.153533 Dec 24 05:00:37.145110 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 129/274] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:36 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:37.412052 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:37.412701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:37.418963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.419499 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.420374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.420853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.563694 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:37.571821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.163699 Dec 24 05:00:37.572433 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 130/275] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:37 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:37.765622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:37.766231 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:37.772347 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.772861 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.773660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.774086 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.913096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:37.920292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-82431e2e-5a24-4568-82c2-ff21fdff6944 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.158483 Dec 24 05:00:37.920998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 131/276] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:37 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:37.925218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:37.925808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:37.931197 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.931634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.932426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:37.932877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:37.997541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:38.005441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1217 microversion: 2.1 time: 0.083492 Dec 24 05:00:38.005980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 132/277] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:37 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:38.165053 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:38.165924 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:38.175971 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:38.176770 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:38.178042 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:38.178750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:38.316686 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:38.324711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.165693 Dec 24 05:00:38.325280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 133/278] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:38 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:38.594519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:38.595709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:38.606437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:38.607179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:38.608771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:38.609203 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:38.721637 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f165b6b6-ef1c-42d6-bbc8-35518ddca93d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 19722 microversion: 2.20 time: 4.175633 Dec 24 05:00:38.722497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 146/279] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:34 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 19722 bytes in 4178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:38.745972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:38.756121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-42b918a9-39eb-476d-a637-25cda33a9fa3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.168268 Dec 24 05:00:38.756874 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 134/280] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:38 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:38.938241 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:38.945308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:38.946221 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:38.946668 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:38.947475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:38.947914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.022299 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:39.023000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:39.030623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.031606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.032623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.033214 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.096620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:39.115671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:39.120552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75fee885-6051-420f-8f69-3c42e1bed839 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.186671 Dec 24 05:00:39.121378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 147/281] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:38 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:39.125355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2ed79332-181c-43e1-a888-00329706b245 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1209 microversion: 2.1 time: 0.107088 Dec 24 05:00:39.135397 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 135/282] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:39 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:39.341991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:39.342608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:39.349159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.349600 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.350373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.350825 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.484511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:39.492759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c756095f-23c9-4928-98e7-ce7500054ea3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.154417 Dec 24 05:00:39.493338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 148/283] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:39 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:39.734202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c09ca2ad-54aa-4640-8aeb-00f61ae6e90c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:39.735228 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c09ca2ad-54aa-4640-8aeb-00f61ae6e90c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:39.742700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09ca2ad-54aa-4640-8aeb-00f61ae6e90c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.743143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09ca2ad-54aa-4640-8aeb-00f61ae6e90c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.743930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09ca2ad-54aa-4640-8aeb-00f61ae6e90c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.744355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09ca2ad-54aa-4640-8aeb-00f61ae6e90c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.774438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:39.775043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:39.781913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.782406 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.783248 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:39.783708 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:39.929863 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:39.938157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3a4d5427-7e68-4728-8513-2873af94b266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.168656 Dec 24 05:00:39.938729 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 149/284] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:39 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:39.954248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c09ca2ad-54aa-4640-8aeb-00f61ae6e90c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 21929 microversion: 2.20 time: 0.224022 Dec 24 05:00:39.955110 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 136/285] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:39 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 21929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:40.138350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:40.139274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:40.143885 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:40.144596 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:40.145767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.146186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.147302 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.147911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.151512 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.151958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.152779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.153194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.237156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:40.247144 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-07507a47-7496-4807-81a7-a6cce5718afb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1271 microversion: 2.1 time: 0.107815 Dec 24 05:00:40.256267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 137/286] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:40 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:40.293956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:40.302959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-45c08a34-fb37-462a-8e2d-7fca011ea894 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.168893 Dec 24 05:00:40.304455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 150/287] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:40 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:40.509678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:40.510286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:40.517504 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.517968 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.519069 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.519481 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.772069 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:40.782595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f6dba0d5-dbd8-4e40-9dde-49895761d340 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.276552 Dec 24 05:00:40.783172 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 138/288] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:40 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:40.955379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:40.961904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:40.970212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-905ef402-ba41-422f-8f26-dbf3f415eff7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:40.971239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-905ef402-ba41-422f-8f26-dbf3f415eff7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:40.971898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.972546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.973592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.974321 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:40.998690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-905ef402-ba41-422f-8f26-dbf3f415eff7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:40.999583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-905ef402-ba41-422f-8f26-dbf3f415eff7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.000617 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-905ef402-ba41-422f-8f26-dbf3f415eff7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.001190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-905ef402-ba41-422f-8f26-dbf3f415eff7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.158475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:41.165746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-905ef402-ba41-422f-8f26-dbf3f415eff7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 23211 microversion: 2.20 time: 0.202479 Dec 24 05:00:41.175267 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.215894 Dec 24 05:00:41.175735 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 139/289] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:40 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 23211 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:00:41.176552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 151/290] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:40 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:41.224466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "tag": "639654f0-9663-4da1-8410-7e554500497a"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:41.225980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:41.225980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:00:41.234533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.234990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.246298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c service nova] Creating event network-changed:639654f0-9663-4da1-8410-7e554500497a for instance df4a8b5b-4054-465a-81a5-1e3cd5b5997b on hv-cinder-81644 Dec 24 05:00:41.250967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030916 Dec 24 05:00:41.251894 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 140/291] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:41.265942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:41.266486 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:41.272398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.272891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.273750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.274107 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.322474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:41.323283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:41.330604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.331116 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.331997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.332889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.459484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:41.468266 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b778c014-264c-434e-8530-309914609e51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.207160 Dec 24 05:00:41.469248 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 152/292] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:41 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:41.797244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:41.799023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:41.799724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:41.805799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.806239 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.807005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:41.807428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:41.808463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.489899 Dec 24 05:00:41.818121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 141/293] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:41 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:41.952881 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:41.962710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5b1a609a-30ec-49c3-8678-ab442039cccf tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.167313 Dec 24 05:00:41.963362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 153/294] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:41 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:42.183403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7e46a320-6d03-44a4-8869-583bedae1509 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:42.186069 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7e46a320-6d03-44a4-8869-583bedae1509 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:42.191887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7e46a320-6d03-44a4-8869-583bedae1509 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.192327 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7e46a320-6d03-44a4-8869-583bedae1509 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.193398 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7e46a320-6d03-44a4-8869-583bedae1509 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.193591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7e46a320-6d03-44a4-8869-583bedae1509 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.194063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:42.194648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:42.201205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.201649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.202713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.203118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.339292 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:42.346814 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3ee900a2-4586-4572-9926-d6cd084d8117 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.157081 Dec 24 05:00:42.347535 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 154/295] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:42 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:42.484899 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:42.485505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:42.491271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.491706 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.492476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.492928 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.626665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:42.637077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6ccc9abb-4253-4469-84a6-15b387b8f496 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.155998 Dec 24 05:00:42.637637 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 155/296] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:42 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:42.825563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:42.826162 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:42.832225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.832699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.833460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.833883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.964979 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:42.974021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1717b2db-f6da-469d-bd64-835ca1cb1280 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.150849 Dec 24 05:00:42.974021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 156/297] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:42 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:42.980724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:42.981452 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:42.988357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.988825 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:42.989786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:42.990210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:43.127079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:43.135151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-155247fc-bf60-4215-9a9f-fc19bfe8a729 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.157967 Dec 24 05:00:43.135805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 157/298] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:42 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:43.364438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:43.365105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:43.371435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:43.371865 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:43.372665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:43.373080 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:43.510487 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:43.518441 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.157831 Dec 24 05:00:43.519020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 158/299] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:43 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:43.653715 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:43.654317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:43.660398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:43.660878 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:43.661613 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:43.662036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:43.803261 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:43.812188 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e49c02b0-4f84-4134-9798-86769f6dd30c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.162064 Dec 24 05:00:43.812996 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 159/300] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:43 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:43.989794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:43.990418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:43.996971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:43.997459 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:43.998261 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:43.998667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:44.138447 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:44.146626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3425b878-9fc2-4894-a16c-2d8448978142 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.160041 Dec 24 05:00:44.147445 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 160/301] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:43 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:44.152764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:44.153363 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:44.159475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:44.159915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:44.160725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:44.161155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:44.293137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:44.301554 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a7674582-a7dc-404c-95bc-d73dfeb9a175 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.152946 Dec 24 05:00:44.302123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 161/302] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:44 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:44.535235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:44.535898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:44.542223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:44.542674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:44.543449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:44.543879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:44.675841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:44.683155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-38f49ad3-706a-442d-b4ad-f826084ae032 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.151569 Dec 24 05:00:44.683696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 162/303] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:44 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:44.829561 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:44.830172 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:44.836488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:44.836968 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:44.837730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:44.838162 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:44.967474 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:44.974853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-66f24304-9662-4418-a918-38cfaaf8f9b7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.148922 Dec 24 05:00:44.975415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 163/304] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:44 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:45.162949 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:45.164196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:45.170463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:45.171042 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:45.171779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:45.172197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:45.307268 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:45.319684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.157733 Dec 24 05:00:45.325870 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 164/305] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:45 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:45.330370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:45.330571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:45.337098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:45.337545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:45.338338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:45.338764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:45.486186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:45.494028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b9951644-4be3-431c-b50a-c4a9b86f3d27 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.172814 Dec 24 05:00:45.494613 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 165/306] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:45 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:45.699136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:45.699470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:45.705654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:45.706079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:45.706853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:45.707276 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:45.845683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:45.853930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-31f85a2c-d105-4290-87da-bc122e62847f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.158553 Dec 24 05:00:45.854589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 166/307] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:45 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:45.991344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:45.991950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:45.998510 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:45.998909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:45.999691 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:46.000229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:46.132586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:46.140240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ffcfe2ce-acf9-455c-8515-c75077682c41 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.152536 Dec 24 05:00:46.143029 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 167/308] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:45 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:46.337094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:46.337767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:46.345901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:46.346337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:46.347118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:46.347587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:46.499119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:46.507207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ef35607e-96a6-4c9f-bd11-1887532a7f41 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.173921 Dec 24 05:00:46.507758 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 168/309] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:46 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:46.512370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:46.512997 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:46.520124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:46.520124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:46.520551 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:46.521088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:46.672125 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:46.680859 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-afffb87d-44d2-482e-9eaa-738b098d10dc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.172080 Dec 24 05:00:46.681402 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 169/310] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:46 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:46.871441 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:46.872274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:46.881284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:46.882147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:46.884050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:46.885161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:47.036902 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:47.044859 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-180da05c-008f-43cd-bace-a89cbef0be27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.177527 Dec 24 05:00:47.045473 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 170/311] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:46 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:47.160207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:47.160905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:47.169335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:47.169766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:47.170778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:47.171000 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:47.327813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:47.335250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7caca8f8-2358-4ae0-8f50-aba103824c98 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.179647 Dec 24 05:00:47.335798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 171/312] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:47 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:47.526420 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:47.527167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:47.534545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:47.535128 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:47.535914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:47.536603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:47.689676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:47.697617 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1fa4bcc9-910c-4469-874c-1416e56580b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.175217 Dec 24 05:00:47.698396 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 172/313] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:47 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:47.703494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:47.704144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:47.712882 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:47.713467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:47.714253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:47.714717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:47.896246 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:47.904357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e0f3062e-bed4-4e57-8abc-0178dae70612 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.204863 Dec 24 05:00:47.906187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 173/314] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:47 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:48.062510 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:48.063108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:48.069521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.069942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.070710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.071133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.209434 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:48.217982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-930e43ef-162f-4d10-b77d-2fdcf8838333 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.159534 Dec 24 05:00:48.218556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 174/315] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:48 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:48.315411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7e46a320-6d03-44a4-8869-583bedae1509 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 27737 microversion: 2.20 time: 6.135772 Dec 24 05:00:48.320744 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 142/316] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:42 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 27737 bytes in 6142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:48.351992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:48.352834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:48.359140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.359737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.360791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.361250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.508589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:48.516060 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.167972 Dec 24 05:00:48.518219 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-31adbe7c-ae75-4641-abf9-010f3c7d15af req-8229214a-a733-4dbb-8ded-64cddec377aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:48.520925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:48.520925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:00:48.525760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 175/317] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:48 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:48.532852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-31adbe7c-ae75-4641-abf9-010f3c7d15af req-8229214a-a733-4dbb-8ded-64cddec377aa service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.533492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-31adbe7c-ae75-4641-abf9-010f3c7d15af req-8229214a-a733-4dbb-8ded-64cddec377aa service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.547375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-31adbe7c-ae75-4641-abf9-010f3c7d15af req-8229214a-a733-4dbb-8ded-64cddec377aa service nova] Creating event network-vif-plugged:b0bd939a-1211-4ec1-b074-b2767d087f95 for instance cccacaaf-be31-4169-8a5b-13ea806dbd2c on hv-cinder-81644 Dec 24 05:00:48.556961 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-31adbe7c-ae75-4641-abf9-010f3c7d15af req-8229214a-a733-4dbb-8ded-64cddec377aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043817 Dec 24 05:00:48.557993 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 143/318] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:00:48.719061 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:48.719848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:48.726008 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.726728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.727700 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.728422 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.889454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:48.897957 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-52444fcc-b86d-4b78-b394-4040aa66ab55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.185266 Dec 24 05:00:48.899724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 176/319] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:48 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:48.923689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:48.924283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:48.930912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.931351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:48.932123 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:48.932568 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.233288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:49.235833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:49.240682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:49.244634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-80a06034-4dba-4e28-a1f8-4cc592075da3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1553 microversion: 2.1 time: 0.326788 Dec 24 05:00:49.245544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 144/320] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:48 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:49.251753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.252709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.253704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.254340 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.327261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e9fad681-5b2c-4b0a-9a6f-da751e1b2565 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:49.328643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e9fad681-5b2c-4b0a-9a6f-da751e1b2565 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:49.337447 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e9fad681-5b2c-4b0a-9a6f-da751e1b2565 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.337890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e9fad681-5b2c-4b0a-9a6f-da751e1b2565 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.338683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e9fad681-5b2c-4b0a-9a6f-da751e1b2565 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.339112 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e9fad681-5b2c-4b0a-9a6f-da751e1b2565 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.431800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:49.440815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-93647224-77e5-44c7-b191-27f2b8a2706c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.209630 Dec 24 05:00:49.441662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 177/321] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:49 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:49.485145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-00fe5fb2-7a99-424c-a303-2e82399a45e5 req-cbee967e-680a-40ac-801d-1db065935526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-deleted", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:49.486885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:49.486885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:00:49.493858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-00fe5fb2-7a99-424c-a303-2e82399a45e5 req-cbee967e-680a-40ac-801d-1db065935526 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.494490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-00fe5fb2-7a99-424c-a303-2e82399a45e5 req-cbee967e-680a-40ac-801d-1db065935526 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.505460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-00fe5fb2-7a99-424c-a303-2e82399a45e5 req-cbee967e-680a-40ac-801d-1db065935526 service nova] Creating event network-vif-deleted:c20bf82b-830b-4f29-b2bf-97f490cf78c9 for instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe on hv-cinder-81644 Dec 24 05:00:49.510543 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-00fe5fb2-7a99-424c-a303-2e82399a45e5 req-cbee967e-680a-40ac-801d-1db065935526 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029382 Dec 24 05:00:49.511136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 178/322] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:00:49.532761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:49.533583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:49.539947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.540391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.541200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.541634 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.684781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:49.694407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.165640 Dec 24 05:00:49.703806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 179/323] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:49 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:49.917698 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:49.918584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:49.924894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.925340 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:49.926114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:49.926534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.057026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:50.064690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c892605f-87ba-4b37-a277-2d8580a2afd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.153051 Dec 24 05:00:50.065362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 180/324] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:49 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:50.210905 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e9fad681-5b2c-4b0a-9a6f-da751e1b2565 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 27803 microversion: 2.20 time: 0.887309 Dec 24 05:00:50.211753 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 145/325] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:49 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 27803 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:50.261379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:50.262489 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:50.269824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:50.270292 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.271067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:50.271520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.333773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61664b664e1d45e686290d000f94f5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:50.342389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7f68fb23-5472-465e-aed9-0fad7c0b7aee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 200 len: 1345 microversion: 2.1 time: 0.084420 Dec 24 05:00:50.343223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 181/326] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:50 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:50.457854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:50.458540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:50.465775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:50.466145 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.466925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:50.467392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.578223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-59d7e9cd-59e3-49c2-aa4c-ade26d6a7c2a req-5379eabe-7fb2-4983-99f5-82985ffac04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-unplugged", "status": "completed", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:50.580514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:50.580514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:00:50.591970 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-59d7e9cd-59e3-49c2-aa4c-ade26d6a7c2a req-5379eabe-7fb2-4983-99f5-82985ffac04f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:50.592548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-59d7e9cd-59e3-49c2-aa4c-ade26d6a7c2a req-5379eabe-7fb2-4983-99f5-82985ffac04f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.605208 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:50.612911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-405de2c0-8b76-4a82-99b6-9d979e637b80 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.159012 Dec 24 05:00:50.613470 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 146/327] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:50 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:50.617709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-59d7e9cd-59e3-49c2-aa4c-ade26d6a7c2a req-5379eabe-7fb2-4983-99f5-82985ffac04f service nova] Creating event network-vif-unplugged:c20bf82b-830b-4f29-b2bf-97f490cf78c9 for instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe on hv-cinder-81644 Dec 24 05:00:50.624947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-59d7e9cd-59e3-49c2-aa4c-ade26d6a7c2a req-5379eabe-7fb2-4983-99f5-82985ffac04f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050892 Dec 24 05:00:50.625694 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 182/328] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:50.713935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:50.714544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:50.722210 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:50.722645 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.723832 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:50.724405 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:50.885941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:50.908358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a2d2b296-1593-44d2-95cf-42603b86121f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.199724 Dec 24 05:00:50.909017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 147/329] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:50 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:51.082546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:51.083266 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:51.089624 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.090094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.090926 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.091403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.223129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-effc27c9-a6fe-4632-9dc6-850255933cd1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:51.224153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-effc27c9-a6fe-4632-9dc6-850255933cd1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:51.233365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-effc27c9-a6fe-4632-9dc6-850255933cd1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.233882 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-effc27c9-a6fe-4632-9dc6-850255933cd1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.234671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-effc27c9-a6fe-4632-9dc6-850255933cd1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.235091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-effc27c9-a6fe-4632-9dc6-850255933cd1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.255984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:51.264103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-884d4ff6-2858-4c3f-a866-967fda36334f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1317 microversion: 2.1 time: 0.185897 Dec 24 05:00:51.265294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 183/330] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:51 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:51.352660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-effc27c9-a6fe-4632-9dc6-850255933cd1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28048 microversion: 2.20 time: 0.133051 Dec 24 05:00:51.353343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 148/331] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:51 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28048 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:00:51.359334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:51.360041 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:51.367274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.367752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.368544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.368987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.389415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] HTTP exception thrown: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. Dec 24 05:00:51.390058 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Returning 404 to user: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:00:51.391047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b30c02b3-e3aa-47ad-8c6e-f75a82867d85 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 404 len: 111 microversion: 2.1 time: 0.035657 Dec 24 05:00:51.391654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 184/332] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:51 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:00:51.496600 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:51.497936 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:51.508552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.509289 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.510460 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.511067 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.525829 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] HTTP exception thrown: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. Dec 24 05:00:51.526422 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Returning 404 to user: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:00:51.527227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-869d945d-9888-4bb7-ae62-108255eb4a34 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037579 Dec 24 05:00:51.527740 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 149/333] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:51 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:00:51.630136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:51.630734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:51.636895 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.637477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.638268 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.638693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.776001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:51.785257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9f5a8031-4258-4542-9e71-38d38c9de096 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.158908 Dec 24 05:00:51.786363 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 185/334] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:51 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:51.926955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:51.927640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:51.934330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.934778 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:51.935587 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:51.936015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.085296 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:52.093332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.169949 Dec 24 05:00:52.094015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 150/335] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:51 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:52.282045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:52.282826 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:52.289342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.289785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.290593 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.291110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.365036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d361e232-ff17-4e05-9cb5-b78e53e5c0e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:52.366036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d361e232-ff17-4e05-9cb5-b78e53e5c0e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:52.372382 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d361e232-ff17-4e05-9cb5-b78e53e5c0e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.372945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d361e232-ff17-4e05-9cb5-b78e53e5c0e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.373850 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d361e232-ff17-4e05-9cb5-b78e53e5c0e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.374425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d361e232-ff17-4e05-9cb5-b78e53e5c0e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.435956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:52.443460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ab519bc4-ecf8-4988-a2f0-175c43542e6e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1508 microversion: 2.1 time: 0.165449 Dec 24 05:00:52.444028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 186/336] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:52 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:52.459259 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da65d192-60f8-4e65-b11d-4773c30ceefc"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:52.460707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:52.466753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.467223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.468133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.468592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.506868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d361e232-ff17-4e05-9cb5-b78e53e5c0e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.145669 Dec 24 05:00:52.507517 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 151/337] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:52 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:52.546874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] HTTP exception thrown: Invalid volume: volume da65d192-60f8-4e65-b11d-4773c30ceefc is already attached to instances: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e Dec 24 05:00:52.547466 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Returning 400 to user: Invalid volume: volume da65d192-60f8-4e65-b11d-4773c30ceefc is already attached to instances: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:00:52.548287 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e1fa876f-faba-4a7f-b297-6e4e702f1244 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092753 Dec 24 05:00:52.548890 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 187/338] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:00:52 2021] POST /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 24 05:00:52.608009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:52.608606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:52.615456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.615900 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.616692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.617131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.743040 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'services' on Instance uuid 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:00:52.803028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:52.804490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:52.812222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.812731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.813519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.813947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.861864 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-552b0c58-f4d9-4760-b04c-fbfa77244e2a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments/da65d192-60f8-4e65-b11d-4773c30ceefc" status: 202 len: 0 microversion: 2.1 time: 0.257580 Dec 24 05:00:52.862526 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 152/339] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:00:52 2021] DELETE /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments/da65d192-60f8-4e65-b11d-4773c30ceefc => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:52.872826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e67ce3fb-6725-46c3-a780-c1d48357d007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:52.874728 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e67ce3fb-6725-46c3-a780-c1d48357d007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:52.881807 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e67ce3fb-6725-46c3-a780-c1d48357d007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.882236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e67ce3fb-6725-46c3-a780-c1d48357d007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.883075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e67ce3fb-6725-46c3-a780-c1d48357d007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:52.883690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e67ce3fb-6725-46c3-a780-c1d48357d007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:52.918249 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e67ce3fb-6725-46c3-a780-c1d48357d007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051033 Dec 24 05:00:52.922295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 153/340] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:52 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:00:52.953194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:52.961570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4ffcdd32-aa85-4298-b033-feef5431a6af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.162160 Dec 24 05:00:52.971442 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 188/341] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:52 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:53.110563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:53.111169 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:53.121533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.122047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.122968 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.123680 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.291354 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:53.298869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1a1ca54d-502a-4caf-9699-6989077cf21f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.192252 Dec 24 05:00:53.299565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 154/342] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:53 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:53.518625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8e96a77c-1720-496a-b5cc-a3d8681b703b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:53.519590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8e96a77c-1720-496a-b5cc-a3d8681b703b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:53.538227 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e96a77c-1720-496a-b5cc-a3d8681b703b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.538676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e96a77c-1720-496a-b5cc-a3d8681b703b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.539554 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e96a77c-1720-496a-b5cc-a3d8681b703b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.539894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e96a77c-1720-496a-b5cc-a3d8681b703b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.682050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8e96a77c-1720-496a-b5cc-a3d8681b703b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.167269 Dec 24 05:00:53.683586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 189/343] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:53 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:53.795328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:53.796366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:53.802802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.803251 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.804033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.804451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.818888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] HTTP exception thrown: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. Dec 24 05:00:53.819400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Returning 404 to user: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:00:53.820220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5a02e1dc-31ac-48d8-a7ea-5cd9021b2c21 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "DELETE /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 404 len: 111 microversion: 2.1 time: 0.028690 Dec 24 05:00:53.820797 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 155/344] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:00:53 2021] DELETE /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:00:53.829403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:53.830087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] [instance: de66f13f-d7ee-49ab-b071-e5b7acd3b2fe] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:53.837301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.837743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.838517 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.838946 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.854603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] HTTP exception thrown: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. Dec 24 05:00:53.854603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Returning 404 to user: Instance de66f13f-d7ee-49ab-b071-e5b7acd3b2fe could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:00:53.854603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0dba3063-3140-408e-8c9f-da18c5d47106 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe" status: 404 len: 111 microversion: 2.1 time: 0.029153 Dec 24 05:00:53.854912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 190/345] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:53 2021] GET /compute/v2.1/servers/de66f13f-d7ee-49ab-b071-e5b7acd3b2fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:00:53.930800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-79c102d9-1867-46f0-baff-22e5c8e5fb40 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:53.931848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-79c102d9-1867-46f0-baff-22e5c8e5fb40 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:53.938516 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79c102d9-1867-46f0-baff-22e5c8e5fb40 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.939208 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79c102d9-1867-46f0-baff-22e5c8e5fb40 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.940277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79c102d9-1867-46f0-baff-22e5c8e5fb40 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.940679 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79c102d9-1867-46f0-baff-22e5c8e5fb40 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.971518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-79c102d9-1867-46f0-baff-22e5c8e5fb40 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Dec 24 05:00:53.973989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 156/346] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:53 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:53.981094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:53.981898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:53.989206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.989787 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:53.990596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:53.991015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:54.138480 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:54.146992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b0777c2c-71d6-401b-bba3-878707a376d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.171137 Dec 24 05:00:54.147591 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 191/347] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:53 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:54.316340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:54.316979 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:54.323333 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:54.323770 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:54.326622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:54.327740 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:54.499552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:54.506749 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c1bacea7-f762-46d7-ac65-b157939761cb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.194326 Dec 24 05:00:54.507309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 157/348] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:54 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:54.694186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-13e8810c-9fcc-4c59-868e-50ed117e0667 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:54.695112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-13e8810c-9fcc-4c59-868e-50ed117e0667 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:54.701626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e8810c-9fcc-4c59-868e-50ed117e0667 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:54.702136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e8810c-9fcc-4c59-868e-50ed117e0667 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:54.703237 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e8810c-9fcc-4c59-868e-50ed117e0667 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:54.703710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13e8810c-9fcc-4c59-868e-50ed117e0667 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:54.983077 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-27d6ff86-fc77-4d54-b9c0-ea4f20745215 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:54.983989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-27d6ff86-fc77-4d54-b9c0-ea4f20745215 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:54.990282 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27d6ff86-fc77-4d54-b9c0-ea4f20745215 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:54.990725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27d6ff86-fc77-4d54-b9c0-ea4f20745215 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:54.991495 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27d6ff86-fc77-4d54-b9c0-ea4f20745215 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:54.992002 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27d6ff86-fc77-4d54-b9c0-ea4f20745215 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:55.021824 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-27d6ff86-fc77-4d54-b9c0-ea4f20745215 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 Dec 24 05:00:55.022385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 158/349] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:54 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:55.162875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:55.163837 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:55.170047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:55.170547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:55.171389 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:55.171820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:55.323854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:55.331731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.172599 Dec 24 05:00:55.332294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 159/350] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:55 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:55.590195 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-71f8362f-2edb-4d03-afe6-25d6cc0c0fbd tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Action: 'create', calling method: .version_select at 0x7f7bae258af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-907504972"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:55.951193 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-71f8362f-2edb-4d03-afe6-25d6cc0c0fbd tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.473789 Dec 24 05:00:55.951877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 160/351] 10.222.0.43 () {60 vars in 1154 bytes} [Fri Dec 24 05:00:55 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 475 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 24 05:00:55.956460 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:55.957088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:55.966062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:55.966698 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:55.967601 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:55.968120 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:56.119046 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:56.128962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.175313 Dec 24 05:00:56.130072 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 161/352] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:55 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:56.134803 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-35a81923-384b-46ef-be4a-c1480a93914f tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae258790>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:56.187204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-35a81923-384b-46ef-be4a-c1480a93914f tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.056004 Dec 24 05:00:56.188240 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 162/353] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:00:56 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:56.196330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-05ce63f8-706a-465f-a2e1-b71a86a15a03 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:56.197880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-05ce63f8-706a-465f-a2e1-b71a86a15a03 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:56.207312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-05ce63f8-706a-465f-a2e1-b71a86a15a03 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:56.207985 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-05ce63f8-706a-465f-a2e1-b71a86a15a03 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:56.209236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-05ce63f8-706a-465f-a2e1-b71a86a15a03 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:56.210142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-05ce63f8-706a-465f-a2e1-b71a86a15a03 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:56.244787 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-05ce63f8-706a-465f-a2e1-b71a86a15a03 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055132 Dec 24 05:00:56.245328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 163/354] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:56 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:56.349037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:56.349631 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:56.356061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:56.356498 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:56.357290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:56.357712 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:56.491887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:56.499475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4904c72e-17d1-4e2a-88ce-62fda7be913d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.154206 Dec 24 05:00:56.500033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 164/355] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:56 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:00:57.150022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:57.151067 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:57.161775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:57.162505 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:57.163759 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:57.164466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:57.300305 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:57.308317 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a4ad37d3-16c1-495a-b2b0-155f5f648fba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.164481 Dec 24 05:00:57.308961 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 165/356] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:57 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:57.313281 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cd1e0fc6-983e-430f-bbfb-34c415b04890 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae191e50>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:57.398025 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cd1e0fc6-983e-430f-bbfb-34c415b04890 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.088076 Dec 24 05:00:57.398626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 166/357] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:00:57 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:57.402950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-92e8e59f-5303-40cc-b526-2956e9f9aa13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:57.403891 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-92e8e59f-5303-40cc-b526-2956e9f9aa13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:57.410402 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-92e8e59f-5303-40cc-b526-2956e9f9aa13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:57.410840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-92e8e59f-5303-40cc-b526-2956e9f9aa13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:57.411595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-92e8e59f-5303-40cc-b526-2956e9f9aa13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:57.412018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-92e8e59f-5303-40cc-b526-2956e9f9aa13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:57.441964 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-92e8e59f-5303-40cc-b526-2956e9f9aa13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042226 Dec 24 05:00:57.442430 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 167/358] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:57 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:57.519572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:57.520197 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:57.526944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:57.527444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:57.528268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:57.528750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:57.660468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:57.671973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-130f2090-bb99-490d-a5ac-9bd87e3b07ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.157533 Dec 24 05:00:57.672669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 168/359] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:57 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:58.329303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:58.330279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:58.341399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:58.342121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:58.343239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:58.343779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:58.488370 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:58.496139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-acbbaeb1-e9aa-4863-9000-b213a6e615ea tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.173195 Dec 24 05:00:58.496741 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 169/360] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:58 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:58.500888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a0e96a95-63c6-4ecb-ab01-66a119d66899 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae24b4c0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:58.545538 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a0e96a95-63c6-4ecb-ab01-66a119d66899 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.047613 Dec 24 05:00:58.546021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 170/361] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:00:58 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:58.550326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5cd739b5-d48e-4cad-b10c-2d935011aac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:58.551269 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5cd739b5-d48e-4cad-b10c-2d935011aac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:58.557598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5cd739b5-d48e-4cad-b10c-2d935011aac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:58.558040 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5cd739b5-d48e-4cad-b10c-2d935011aac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:58.558807 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5cd739b5-d48e-4cad-b10c-2d935011aac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:58.559232 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5cd739b5-d48e-4cad-b10c-2d935011aac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:58.588464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-13e8810c-9fcc-4c59-868e-50ed117e0667 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 3.897795 Dec 24 05:00:58.590701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 192/362] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:54 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 3899 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:00:58.595390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5cd739b5-d48e-4cad-b10c-2d935011aac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048368 Dec 24 05:00:58.596228 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 171/363] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:58 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:58.695186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:58.696020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:58.703256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:58.703699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:58.704438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:58.704922 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:58.740548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-2ff3fa09-173d-42a0-a327-46b22985e965 req-c4b45aea-7774-4c71-a100-e3be5706f8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "name": "network-vif-plugged", "status": "completed", "tag": "639654f0-9663-4da1-8410-7e554500497a"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:58.742124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:58.742124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:00:58.749241 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-2ff3fa09-173d-42a0-a327-46b22985e965 req-c4b45aea-7774-4c71-a100-e3be5706f8e5 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:58.749918 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-2ff3fa09-173d-42a0-a327-46b22985e965 req-c4b45aea-7774-4c71-a100-e3be5706f8e5 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:58.762606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-2ff3fa09-173d-42a0-a327-46b22985e965 req-c4b45aea-7774-4c71-a100-e3be5706f8e5 service nova] Creating event network-vif-plugged:639654f0-9663-4da1-8410-7e554500497a for instance df4a8b5b-4054-465a-81a5-1e3cd5b5997b on hv-cinder-81644 Dec 24 05:00:58.768797 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-2ff3fa09-173d-42a0-a327-46b22985e965 req-c4b45aea-7774-4c71-a100-e3be5706f8e5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031831 Dec 24 05:00:58.769611 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 172/364] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:00:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:58.843057 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:58.850768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-94c1b2f7-2200-434a-88f9-615962bc6ab1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.159594 Dec 24 05:00:58.851332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 193/365] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:58 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:59.516009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:59.516725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:59.526202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.526835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.528015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.528575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.557468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2cd8fcc4-4d63-406b-98ef-34d8a208c93d tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae9633a0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:59.608214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2cd8fcc4-4d63-406b-98ef-34d8a208c93d tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.054087 Dec 24 05:00:59.613804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 194/366] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:00:59 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:59.618447 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-70eb5aa1-3683-43a8-919e-74929ab9b268 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:00:59.619435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-70eb5aa1-3683-43a8-919e-74929ab9b268 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:59.626102 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70eb5aa1-3683-43a8-919e-74929ab9b268 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.626545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70eb5aa1-3683-43a8-919e-74929ab9b268 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.627389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70eb5aa1-3683-43a8-919e-74929ab9b268 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.627823 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-70eb5aa1-3683-43a8-919e-74929ab9b268 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.671009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:00:59.678184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-69d86828-3bf4-4abe-8061-df8e9dee5772 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.168479 Dec 24 05:00:59.678748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 173/367] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:59 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:00:59.683284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-26e4cff5-b542-4088-b589-0a976e0986fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:59.683942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-26e4cff5-b542-4088-b589-0a976e0986fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:59.690707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-26e4cff5-b542-4088-b589-0a976e0986fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.691248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-26e4cff5-b542-4088-b589-0a976e0986fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.691893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-26e4cff5-b542-4088-b589-0a976e0986fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.692319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-26e4cff5-b542-4088-b589-0a976e0986fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.721745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-26e4cff5-b542-4088-b589-0a976e0986fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041998 Dec 24 05:00:59.722267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 174/368] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:00:59 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:00:59.867250 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:00:59.867849 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:00:59.874746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.875173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.875967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:00:59.876391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:00:59.914891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-70eb5aa1-3683-43a8-919e-74929ab9b268 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.299721 Dec 24 05:00:59.915533 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 195/369] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:00:59 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:00.015372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:00.026533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-872463e1-7c15-415c-a6bb-8321a32793c1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.162750 Dec 24 05:01:00.027319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 175/370] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:00:59 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:00.621989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-57f2536b-0d41-4ca6-b82c-96df1b874d50 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae9beaf0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:00.678733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-57f2536b-0d41-4ca6-b82c-96df1b874d50 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 345 microversion: 2.1 time: 0.060842 Dec 24 05:01:00.679296 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 196/371] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:00 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:00.690100 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-935bfbfa-5b2b-4f5c-a122-848d87371c1c tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Action: 'create', calling method: .version_select at 0x7f7bae24b0d0>, body: {"snapshot": {"volume_id": "1d0d2a8b-f4f1-4015-9437-5fa593849856", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-558628683"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:00.694824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:00.695556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:00.702889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:00.703553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:00.704348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:00.705079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:00.875574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:00.882906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1313 microversion: 2.1 time: 0.191660 Dec 24 05:01:00.883470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 197/372] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:00 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:00.889409 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-98f4b3c0-6ad3-475e-876a-3058b9d06571 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:00.890317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-98f4b3c0-6ad3-475e-876a-3058b9d06571 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:00.896757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98f4b3c0-6ad3-475e-876a-3058b9d06571 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:00.897201 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98f4b3c0-6ad3-475e-876a-3058b9d06571 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:00.897983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98f4b3c0-6ad3-475e-876a-3058b9d06571 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:00.898409 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98f4b3c0-6ad3-475e-876a-3058b9d06571 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:00.931740 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-98f4b3c0-6ad3-475e-876a-3058b9d06571 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046092 Dec 24 05:01:00.932294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 198/373] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:01:00 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:01:00.937276 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b8fdbd6a-0de9-4ae0-badc-dd234b044a8b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:00.938200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b8fdbd6a-0de9-4ae0-badc-dd234b044a8b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:00.945303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b8fdbd6a-0de9-4ae0-badc-dd234b044a8b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:00.945767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b8fdbd6a-0de9-4ae0-badc-dd234b044a8b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:00.946606 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b8fdbd6a-0de9-4ae0-badc-dd234b044a8b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:00.947041 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b8fdbd6a-0de9-4ae0-badc-dd234b044a8b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:00.951962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-935bfbfa-5b2b-4f5c-a122-848d87371c1c tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.265106 Dec 24 05:01:00.958466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 176/374] 10.222.0.43 () {60 vars in 1161 bytes} [Fri Dec 24 05:01:00 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:01:00.966202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b3114c56-bed3-4e51-a982-e8b6ef68ad16 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae2448b0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:01.049328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b3114c56-bed3-4e51-a982-e8b6ef68ad16 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 286 microversion: 2.1 time: 0.089529 Dec 24 05:01:01.053523 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 177/375] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:00 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:01.063267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:01.064414 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:01.074607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:01.075349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:01.076323 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:01.077120 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:01.112037 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b8fdbd6a-0de9-4ae0-badc-dd234b044a8b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.178188 Dec 24 05:01:01.113821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 199/376] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:00 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:01.120377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-48ace53e-bdfa-4246-b14b-07dce1b9aaf5 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae9869d0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:01.169818 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-48ace53e-bdfa-4246-b14b-07dce1b9aaf5 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.054505 Dec 24 05:01:01.175473 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 200/377] 10.222.0.43 () {58 vars in 1139 bytes} [Fri Dec 24 05:01:01 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:01.175473 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-209580320", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "b92a87f3-957a-4ccb-9b5b-98ad92aebe6e"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:01.232431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:01.238732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] validate_networks() for [('b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:01:01.242361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.187446 Dec 24 05:01:01.243158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 178/378] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:01 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:01.259747 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1a2b678e-5fa9-47d1-9cae-4282bc08c509 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae1c6e50>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:01.308626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1a2b678e-5fa9-47d1-9cae-4282bc08c509 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 286 microversion: 2.1 time: 0.063993 Dec 24 05:01:01.309643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 179/379] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:01 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:01.901204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:01.901875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:01.907865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:01.908319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:01.909139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:01.909563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:01.934633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:01:01.937071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:01:01.937941 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:01:01.939109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:01:01.939713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:01:01.952454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:01.953207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:01.954016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:01.954456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:01.974690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:01:01.979416 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for user f29f576d3a98449b8077c0df53968f07 and project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:01:01.996473 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:01:02.000540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:01:02.052249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1237762b-b812-4bd7-b20d-619afe3e3f0c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880065 Dec 24 05:01:02.053395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 201/380] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:01:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:01:02.064157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e7fb4f40-e585-4c63-8f39-41260dd04c2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:02.064624 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e7fb4f40-e585-4c63-8f39-41260dd04c2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:02.072657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:02.082708 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ac046637-3c8b-4596-a7f4-b8252981d7e2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1498 microversion: 2.1 time: 0.185555 Dec 24 05:01:02.093171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 180/381] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:01 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:02.125124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f518b00f-b915-422d-884c-7f76090c333c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:02.126257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f518b00f-b915-422d-884c-7f76090c333c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:02.135802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f518b00f-b915-422d-884c-7f76090c333c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:02.136439 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f518b00f-b915-422d-884c-7f76090c333c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:02.137361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f518b00f-b915-422d-884c-7f76090c333c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:02.138931 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f518b00f-b915-422d-884c-7f76090c333c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:02.168077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e7fb4f40-e585-4c63-8f39-41260dd04c2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:02.175995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e7fb4f40-e585-4c63-8f39-41260dd04c2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1217 microversion: 2.1 time: 0.116561 Dec 24 05:01:02.185146 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 202/382] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:02 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:02.260403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:02.261139 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:02.270192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:02.273115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:02.273959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:02.278470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:02.462687 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:02.470895 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-94e1d030-a63b-47d1-87b8-f851a61d5319 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.214129 Dec 24 05:01:02.471644 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 203/383] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:02 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:02.484491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-20a4eb41-300b-4ca0-909e-237bb59b1f4e tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7baea00a60>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:02.520142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-20a4eb41-300b-4ca0-909e-237bb59b1f4e tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 286 microversion: 2.1 time: 0.047352 Dec 24 05:01:02.520821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 204/384] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:02 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:03.202636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:03.203412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:03.211546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:03.212275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:03.213392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:03.213911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:03.275907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:03.283622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1221 microversion: 2.1 time: 0.094312 Dec 24 05:01:03.284374 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 205/385] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:03 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:03.488424 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:03.488853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:03.496291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:03.496946 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:03.498115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:03.498790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:03.652325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:03.660187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.175876 Dec 24 05:01:03.660704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 206/386] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:03 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:03.664826 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2647fb00-5e07-42a3-8db5-ae7aac73f192 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7baea9b700>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:03.692538 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2647fb00-5e07-42a3-8db5-ae7aac73f192 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 286 microversion: 2.1 time: 0.030807 Dec 24 05:01:03.693224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 207/387] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:03 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:04.301258 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:04.301948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:04.312269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:04.312269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:04.312269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:04.312269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:04.370386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:04.377881 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1221 microversion: 2.1 time: 0.081319 Dec 24 05:01:04.378436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 208/388] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:04 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:04.676580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:04.677404 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:04.686278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:04.687071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:04.688260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:04.688953 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:04.835623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:04.846982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1daf8df3-bdf0-4d99-872a-257477d15e3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.173961 Dec 24 05:01:04.847829 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 209/389] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:04 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:04.851957 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cb667340-68b3-4de9-9446-425c461d0745 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae9bb310>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:04.881103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cb667340-68b3-4de9-9446-425c461d0745 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 286 microversion: 2.1 time: 0.032206 Dec 24 05:01:04.881676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 210/390] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:04 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:05.398281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:05.399241 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:05.410119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:05.410849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:05.412104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:05.412865 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:05.478552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:05.486586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ee8337da-eee0-4011-8407-195da9a13364 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1221 microversion: 2.1 time: 0.095354 Dec 24 05:01:05.487145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 211/391] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:05 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:05.868383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:05.869431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:05.877631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:05.878074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:05.878849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:05.879269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:06.031961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:06.039906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-44a4d5d3-60de-432b-94f7-cb3394089a11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.177498 Dec 24 05:01:06.040470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 212/392] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:05 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:06.044654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f85efd9c-3339-4fa0-9d30-cfc22bd03ce0 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7baeb5c550>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:06.075537 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f85efd9c-3339-4fa0-9d30-cfc22bd03ce0 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 286 microversion: 2.1 time: 0.034049 Dec 24 05:01:06.076105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 213/393] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:06 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:06.129791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f518b00f-b915-422d-884c-7f76090c333c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 4.009928 Dec 24 05:01:06.130778 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 181/394] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:02 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 4012 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:06.503186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:06.503724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:06.509893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:06.510332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:06.511087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:06.511508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:06.583531 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:06.591622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1269 microversion: 2.1 time: 0.092673 Dec 24 05:01:06.592811 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 214/395] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:06 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1269 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:07.057742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:07.058565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:07.066313 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.066746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.067944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.068626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.087408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-196dce92-6883-4a7f-bdf8-4647e358519d tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae9bb550>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:07.165737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-196dce92-6883-4a7f-bdf8-4647e358519d tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 287 microversion: 2.1 time: 0.082397 Dec 24 05:01:07.166506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 215/396] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:07 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:01:07.171755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-805c3a0b-79a0-4090-8060-c6cc16d7a0e3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:07.172966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-805c3a0b-79a0-4090-8060-c6cc16d7a0e3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:07.180821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-805c3a0b-79a0-4090-8060-c6cc16d7a0e3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.181402 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-805c3a0b-79a0-4090-8060-c6cc16d7a0e3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.182381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-805c3a0b-79a0-4090-8060-c6cc16d7a0e3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.182805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-805c3a0b-79a0-4090-8060-c6cc16d7a0e3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.310377 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:07.318376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.264851 Dec 24 05:01:07.320329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-805c3a0b-79a0-4090-8060-c6cc16d7a0e3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.152148 Dec 24 05:01:07.321520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 216/397] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:07 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:07.328634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 182/398] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:07 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:07.332510 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-732c08be-0fda-4767-8f73-3be8132cbe2a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7baea9b310>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:07.392657 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-732c08be-0fda-4767-8f73-3be8132cbe2a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 202 len: 0 microversion: 2.1 time: 0.069068 Dec 24 05:01:07.393225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 217/399] 10.222.0.43 () {58 vars in 1253 bytes} [Fri Dec 24 05:01:07 2021] DELETE /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:07.402188 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4f6a7d10-4700-40c0-8f54-84eb56ab5e5c tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae13e3a0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:07.435253 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4f6a7d10-4700-40c0-8f54-84eb56ab5e5c tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 200 len: 286 microversion: 2.1 time: 0.036666 Dec 24 05:01:07.435879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 183/400] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:07 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:01:07.483935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:07.484659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:07.490928 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.491572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.492215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.492806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.520431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:01:07.610603 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:07.611584 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:07.622166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.623028 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.625153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.625861 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.644913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "DELETE /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 204 len: 0 microversion: 2.1 time: 0.159939 Dec 24 05:01:07.645828 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 218/401] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:01:07 2021] DELETE /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:01:07.657194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:07.659721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:07.667576 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.668059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.668898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:07.669358 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:07.786341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:07.794865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1b206b19-1b84-4d67-9c4a-07528b6349c9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.189593 Dec 24 05:01:07.795730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 184/402] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:07 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:07.869328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:07.883883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.232998 Dec 24 05:01:07.886578 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 219/403] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:07 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:08.335197 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fa306684-d13b-42d2-aa8b-b8fb2c80bc9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:08.336178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:08.336889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:08.337287 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fa306684-d13b-42d2-aa8b-b8fb2c80bc9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:08.344047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.344855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.345138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa306684-d13b-42d2-aa8b-b8fb2c80bc9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.345579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa306684-d13b-42d2-aa8b-b8fb2c80bc9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.346396 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa306684-d13b-42d2-aa8b-b8fb2c80bc9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.346727 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.346836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa306684-d13b-42d2-aa8b-b8fb2c80bc9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.347449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.506907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:08.508890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fa306684-d13b-42d2-aa8b-b8fb2c80bc9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.178041 Dec 24 05:01:08.511462 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 185/404] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:08 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:08.518691 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.186854 Dec 24 05:01:08.519230 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-029f0d9a-8289-4ca3-aed0-fc883d1d96f1 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae1eaee0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:08.520837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 220/405] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:08 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:08.548178 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-029f0d9a-8289-4ca3-aed0-fc883d1d96f1 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] HTTP exception thrown: Snapshot 22291a84-ed37-40a2-858d-9a36ce87cb99 could not be found. Dec 24 05:01:08.549056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-029f0d9a-8289-4ca3-aed0-fc883d1d96f1 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Returning 404 to user: Snapshot 22291a84-ed37-40a2-858d-9a36ce87cb99 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:01:08.550095 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-029f0d9a-8289-4ca3-aed0-fc883d1d96f1 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99" status: 404 len: 111 microversion: 2.1 time: 0.037224 Dec 24 05:01:08.550842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 186/406] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Dec 24 05:01:08 2021] GET /compute/v2.1/os-snapshots/22291a84-ed37-40a2-858d-9a36ce87cb99 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:01:08.558959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0f887733-e329-4470-a88c-887790422f7b tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7baea00160>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:08.629522 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0f887733-e329-4470-a88c-887790422f7b tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 202 len: 0 microversion: 2.1 time: 0.074073 Dec 24 05:01:08.630533 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 221/407] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Dec 24 05:01:08 2021] DELETE /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:08.639719 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4ef991b8-f6b0-4e46-8061-453fa5d516be tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae1910d0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:08.687620 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4ef991b8-f6b0-4e46-8061-453fa5d516be tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.052824 Dec 24 05:01:08.688279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 187/408] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:08 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:08.736911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:08.738617 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:01:08.738617 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:01:08.745540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.745976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.757693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 service nova] Creating event network-changed:13f44c71-4981-48aa-bff5-6222de8d0cc1 for instance e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 on hv-cinder-81644 Dec 24 05:01:08.762157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029329 Dec 24 05:01:08.763051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 222/409] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:01:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:01:08.812589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:08.812936 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:08.819225 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.819668 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.820469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.820908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.913480 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:08.914437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:08.920886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.923309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.932210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:08.933143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:08.988223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:08.996613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-381e45e6-85d0-4c60-a55c-8a785d5a7779 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.188323 Dec 24 05:01:09.002434 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 188/410] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:08 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:09.115526 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:09.122871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-24f59b7c-53de-4000-b667-ac189d82fad4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.222893 Dec 24 05:01:09.123532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 223/411] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:08 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:09.521994 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-25a312fc-d7e2-48ef-8d8d-d805e13972c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:09.522941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-25a312fc-d7e2-48ef-8d8d-d805e13972c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:09.529177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-25a312fc-d7e2-48ef-8d8d-d805e13972c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:09.529738 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-25a312fc-d7e2-48ef-8d8d-d805e13972c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:09.530516 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-25a312fc-d7e2-48ef-8d8d-d805e13972c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:09.530985 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-25a312fc-d7e2-48ef-8d8d-d805e13972c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:09.535212 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:09.536221 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:09.542204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:09.542642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:09.543664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:09.543834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:09.682096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:09.689752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a163650d-624a-4a9e-87fe-9e9c61cc7dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.158298 Dec 24 05:01:09.690321 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 224/412] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:09 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:09.699289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8cce9625-aa5b-40e0-83a4-f98c7cc46fdd tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7baea9b8b0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:09.748493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8cce9625-aa5b-40e0-83a4-f98c7cc46fdd tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.052958 Dec 24 05:01:09.749171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 225/413] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:09 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:10.022744 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:10.023355 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:10.029476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:10.030026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:10.030813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:10.031250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:10.172285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:10.179979 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e2d2f5b0-dd00-465b-a855-939486dcf060 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.163200 Dec 24 05:01:10.188638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 226/414] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:10 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:10.188638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:10.188638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:10.191191 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:10.191635 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:10.192409 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:10.195976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:10.323443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:10.331418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c7e17f2a-eb87-4965-b486-286db86ce773 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.149596 Dec 24 05:01:10.332240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 227/415] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:10 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:10.706775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:10.708147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:10.714723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:10.715167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:10.715962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:10.716384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:10.856362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:10.866218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1efa1500-6b87-4460-aae7-5cb9bb7f857c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.162962 Dec 24 05:01:10.866983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 228/416] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:10 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:10.874572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bbf42450-863a-4984-b1ee-67f2a77b1763 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae963a60>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:10.924410 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bbf42450-863a-4984-b1ee-67f2a77b1763 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.053697 Dec 24 05:01:10.925056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 229/417] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:10 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:11.202894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:11.203592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:11.212152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:11.212673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:11.213466 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:11.213892 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:11.356156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:11.363998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c17183a7-9872-4f94-ab1c-0cd3fc403525 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.166432 Dec 24 05:01:11.364495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 230/418] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:11 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:11.368945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:11.369812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:11.375331 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:11.375755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:11.376548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:11.376977 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:11.510700 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:11.518240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d2e7e7ec-0e31-460e-adf5-ab998055d024 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.152792 Dec 24 05:01:11.518805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 231/419] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:11 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:11.883400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:11.883989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:11.890436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:11.890883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:11.891659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:11.892085 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:12.031132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:12.040074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.160239 Dec 24 05:01:12.040671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 232/420] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:11 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:12.045540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e03bc71f-0035-45ba-9bf6-3f60a6ece6f1 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae98d430>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:12.095322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e03bc71f-0035-45ba-9bf6-3f60a6ece6f1 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.053425 Dec 24 05:01:12.096142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 233/421] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:12 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:12.383398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:12.384096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:12.392716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:12.393153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:12.393914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:12.394335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:12.542666 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:12.550846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5f2447d8-8a23-461a-be44-61a50a8f3405 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.173218 Dec 24 05:01:12.551399 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 234/422] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:12 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:12.555836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:12.556457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:12.562106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:12.562758 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:12.563585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:12.564054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:12.702460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:12.714273 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d2c1b254-7d38-49ad-a336-cfcae556852a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.161631 Dec 24 05:01:12.715130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 235/423] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:12 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:13.045273 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-25a312fc-d7e2-48ef-8d8d-d805e13972c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 3.526621 Dec 24 05:01:13.046007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 189/424] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:09 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 3528 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:13.057096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:13.057701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:13.064667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:13.065432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:13.066753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:13.067694 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:13.110774 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cf1b97a6-2154-4a63-a445-8a7aff55f971 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae13e790>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:13.162062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cf1b97a6-2154-4a63-a445-8a7aff55f971 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.055372 Dec 24 05:01:13.166978 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 190/425] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:13 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:13.228728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:13.237147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d555bcd1-1b46-4806-8608-48e4dfd56244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.183602 Dec 24 05:01:13.246559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 236/426] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:13 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:13.567446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:13.568163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:13.574627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:13.575049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:13.575852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:13.576266 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:13.718594 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:13.726413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-101d4d96-d2f1-406f-b900-3385badc09b4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.163002 Dec 24 05:01:13.730944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 191/427] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:13 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:13.732117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:13.732748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:13.739266 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:13.739709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:13.740841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:13.741334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:13.881592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:13.892064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-28b87017-4780-4438-836f-63851f59d11f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.163629 Dec 24 05:01:13.892634 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 237/428] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:13 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:14.057006 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d60e1522-61fa-4db2-9501-b8edb023e7d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:14.058619 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d60e1522-61fa-4db2-9501-b8edb023e7d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:14.064819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d60e1522-61fa-4db2-9501-b8edb023e7d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.065180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d60e1522-61fa-4db2-9501-b8edb023e7d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:14.065945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d60e1522-61fa-4db2-9501-b8edb023e7d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.066363 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d60e1522-61fa-4db2-9501-b8edb023e7d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:14.174902 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8839cb1e-9610-45f9-8345-cffc1157d33a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7baea0a040>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:14.223243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8839cb1e-9610-45f9-8345-cffc1157d33a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 200 len: 344 microversion: 2.1 time: 0.052043 Dec 24 05:01:14.223804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 238/429] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:14 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:14.254158 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:14.254771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:14.260886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.261327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:14.262086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.262506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:14.399214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:14.406886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ce64a35b-d985-4154-9342-f5b5b877898f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.156409 Dec 24 05:01:14.407557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 239/430] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:14 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:14.744489 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:14.745143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:14.752414 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.752885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:14.753682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.754134 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:14.794443 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d60e1522-61fa-4db2-9501-b8edb023e7d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.741133 Dec 24 05:01:14.796635 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 192/431] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:14 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:14.895111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:14.902522 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fb098bac-f3a4-4e08-8f7c-09056239cd38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.162625 Dec 24 05:01:14.903117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 240/432] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:14 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:14.910535 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:14.911311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:14.918651 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.919089 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:14.919855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:14.920275 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:15.064881 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:15.075238 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.169463 Dec 24 05:01:15.076177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 193/433] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:14 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:15.235249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d6797492-9bfe-4146-90c3-8df6597cc652 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae9be4c0>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:15.261980 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-d6797492-9bfe-4146-90c3-8df6597cc652 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] HTTP exception thrown: Volume 1d0d2a8b-f4f1-4015-9437-5fa593849856 could not be found. Dec 24 05:01:15.262553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d6797492-9bfe-4146-90c3-8df6597cc652 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Returning 404 to user: Volume 1d0d2a8b-f4f1-4015-9437-5fa593849856 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:01:15.263386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d6797492-9bfe-4146-90c3-8df6597cc652 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 404 len: 109 microversion: 2.1 time: 0.031875 Dec 24 05:01:15.263904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 241/434] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:15 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:01:15.278564 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fc338ae2-9086-4602-aee4-d3b290c051c0 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae191dc0>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:15.305715 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-fc338ae2-9086-4602-aee4-d3b290c051c0 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] HTTP exception thrown: Volume 1d0d2a8b-f4f1-4015-9437-5fa593849856 could not be found. Dec 24 05:01:15.306293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fc338ae2-9086-4602-aee4-d3b290c051c0 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Returning 404 to user: Volume 1d0d2a8b-f4f1-4015-9437-5fa593849856 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:01:15.307198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fc338ae2-9086-4602-aee4-d3b290c051c0 tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 404 len: 109 microversion: 2.1 time: 0.032247 Dec 24 05:01:15.307730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 194/435] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Dec 24 05:01:15 2021] DELETE /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:01:15.316607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2c8e3391-8f7e-44f2-b01e-06c4c01ac85a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Calling method '.version_select at 0x7f7bae9fb790>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:15.344684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-2c8e3391-8f7e-44f2-b01e-06c4c01ac85a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] HTTP exception thrown: Volume 1d0d2a8b-f4f1-4015-9437-5fa593849856 could not be found. Dec 24 05:01:15.345855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2c8e3391-8f7e-44f2-b01e-06c4c01ac85a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] Returning 404 to user: Volume 1d0d2a8b-f4f1-4015-9437-5fa593849856 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:01:15.346710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2c8e3391-8f7e-44f2-b01e-06c4c01ac85a tempest-VolumesSnapshotsTestJSON-157022905 tempest-VolumesSnapshotsTestJSON-157022905-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856" status: 404 len: 109 microversion: 2.1 time: 0.034650 Dec 24 05:01:15.347234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 242/436] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Dec 24 05:01:15 2021] GET /compute/v2.1/os-volumes/1d0d2a8b-f4f1-4015-9437-5fa593849856 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:01:15.424079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:15.424936 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:15.431198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:15.431623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:15.432595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:15.433013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:15.571986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:15.579692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9fd4ac01-0160-4a9d-b435-a3a057905753 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.160179 Dec 24 05:01:15.580262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 195/437] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:15 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:15.808035 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b2f9d4ad-1cf4-4dc3-bbd8-3d73291bae02 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:15.809376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b2f9d4ad-1cf4-4dc3-bbd8-3d73291bae02 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:15.817217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b2f9d4ad-1cf4-4dc3-bbd8-3d73291bae02 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:15.817758 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b2f9d4ad-1cf4-4dc3-bbd8-3d73291bae02 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:15.818583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b2f9d4ad-1cf4-4dc3-bbd8-3d73291bae02 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:15.819038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b2f9d4ad-1cf4-4dc3-bbd8-3d73291bae02 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:15.918702 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:15.919386 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:15.925755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:15.926249 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:15.927117 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:15.927585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:16.133999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:16.148579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-53b87163-d88f-4b53-81c9-bbafb6cb9368 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.234143 Dec 24 05:01:16.150466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 196/438] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:15 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:16.155621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:16.156213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:16.162420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:16.162815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:16.163980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:16.164481 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:16.311280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:16.326820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.175189 Dec 24 05:01:16.327822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 197/439] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:16 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:16.602554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:16.602554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:16.604085 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:16.604551 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:16.605315 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:16.605736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:16.748006 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:16.755659 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1d17a773-85b1-447c-8d89-73fcf5057de7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.162548 Dec 24 05:01:16.756225 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 198/440] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:16 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:17.167692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:17.168513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:17.175373 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:17.175891 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:17.176865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:17.177345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:17.327123 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:17.335624 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-90e0d264-3b08-4160-a461-fa56246e320b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.171818 Dec 24 05:01:17.336481 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 199/441] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:17 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:17.346378 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:17.347057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:17.353060 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:17.353527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:17.354296 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:17.354716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:17.500375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:17.506114 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.163746 Dec 24 05:01:17.506846 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 200/442] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:17 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:17.772735 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:17.773448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:17.779448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:17.779894 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:17.780689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:17.781115 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:17.912449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:17.920015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0094f68c-c059-4ee1-8919-1c8849a413e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.150820 Dec 24 05:01:17.920675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 201/443] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:17 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:18.354021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:18.354622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:18.361581 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:18.361949 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:18.362715 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:18.363142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:18.508579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:18.516677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7cf84114-5aae-4c20-82da-326dc8584632 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.166263 Dec 24 05:01:18.517266 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 202/444] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:18 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:18.522280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:18.522880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:18.530953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:18.531642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:18.533039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:18.533463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:18.667139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:18.675970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c0e30e9c-57ba-487d-bcb7-1629221b2dce tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.157098 Dec 24 05:01:18.676516 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 203/445] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:18 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:18.942811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:18.943678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:18.953862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:18.955079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:18.955863 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:18.956289 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:19.114604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:19.122242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8f7dff89-a773-40cc-abce-0af7d6412610 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.185966 Dec 24 05:01:19.122825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 204/446] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:18 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:19.416867 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b2f9d4ad-1cf4-4dc3-bbd8-3d73291bae02 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 3.612964 Dec 24 05:01:19.417505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 243/447] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:15 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 3615 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:01:19.533573 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:19.534216 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:19.540869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:19.541309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:19.542090 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:19.542518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:19.676276 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:19.684058 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.154529 Dec 24 05:01:19.684675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 205/448] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:19 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:19.693425 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:19.694106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:19.701041 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:19.701475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:19.702235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:19.702683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:19.839150 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:19.846987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-45c8a83c-7e80-446a-af52-39eb282d4521 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1504 microversion: 2.1 time: 0.157533 Dec 24 05:01:19.847547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 244/449] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:19 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:20.138997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:20.140178 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:20.146845 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.147449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.148415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.148959 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.430725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a7c537c6-d49d-4bd6-a5d3-7d0730c2ad6f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:20.434631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a7c537c6-d49d-4bd6-a5d3-7d0730c2ad6f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:20.466751 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7c537c6-d49d-4bd6-a5d3-7d0730c2ad6f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.467194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7c537c6-d49d-4bd6-a5d3-7d0730c2ad6f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.467999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7c537c6-d49d-4bd6-a5d3-7d0730c2ad6f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.468404 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7c537c6-d49d-4bd6-a5d3-7d0730c2ad6f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.512612 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:20.521925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1520 microversion: 2.1 time: 0.386548 Dec 24 05:01:20.522527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 206/450] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:20 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:20.527048 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-d39888f8-583c-44fb-84bf-1698e5b72d7e req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "name": "network-vif-deleted", "tag": "639654f0-9663-4da1-8410-7e554500497a"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:20.529037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:01:20.529037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:01:20.539269 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-d39888f8-583c-44fb-84bf-1698e5b72d7e req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.539880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-d39888f8-583c-44fb-84bf-1698e5b72d7e req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.551720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-d39888f8-583c-44fb-84bf-1698e5b72d7e req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 service nova] Creating event network-vif-deleted:639654f0-9663-4da1-8410-7e554500497a for instance df4a8b5b-4054-465a-81a5-1e3cd5b5997b on hv-cinder-81644 Dec 24 05:01:20.556474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-d39888f8-583c-44fb-84bf-1698e5b72d7e req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032740 Dec 24 05:01:20.557091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 207/451] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:01:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:20.679057 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a7c537c6-d49d-4bd6-a5d3-7d0730c2ad6f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.252093 Dec 24 05:01:20.680625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 245/452] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:20 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:20.718372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:20.719085 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:20.741875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.742346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.743207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.743842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.864554 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:20.865505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:20.872755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.873239 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.874023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.874453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.889011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:20.898241 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-19ba8e58-0ebd-41bd-9263-3c929a207a1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.196692 Dec 24 05:01:20.898908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 208/453] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:20 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:20.905373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:20.905819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:20.906291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lazy-loading 'fault' on Instance uuid df4a8b5b-4054-465a-81a5-1e3cd5b5997b {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:01:20.949492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbefbd7e98c94b7598f4af35532d60cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e014b3683d841968563e0aa0705e862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:20.957563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 200 len: 1303 microversion: 2.1 time: 0.097186 Dec 24 05:01:20.958147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 246/454] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:20 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:21.539071 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:21.539776 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:21.546297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.546783 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:21.547574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.548030 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:21.693298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:21.701501 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1500 microversion: 2.1 time: 0.166159 Dec 24 05:01:21.702365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 209/455] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:21 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:21.718739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:21.720021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:21.727332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.727778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:21.728582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.729020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:21.742424 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cbbd1538-6923-4732-a42a-b604f6a013a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:21.743418 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cbbd1538-6923-4732-a42a-b604f6a013a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:21.750046 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbbd1538-6923-4732-a42a-b604f6a013a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.750566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbbd1538-6923-4732-a42a-b604f6a013a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:21.751569 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbbd1538-6923-4732-a42a-b604f6a013a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.752059 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbbd1538-6923-4732-a42a-b604f6a013a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:21.868559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:21.876129 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8fbea9ac-8957-4970-8116-7502b8d91e3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1514 microversion: 2.1 time: 0.161632 Dec 24 05:01:21.876732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 247/456] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:21 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:21.914958 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:21.915539 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:21.921875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.922312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:21.923127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:21.923553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:22.059833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:22.067581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c27b0c03-2a31-4924-ac72-6119dd86f55b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.156288 Dec 24 05:01:22.068115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 248/457] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:21 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:22.072261 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:22.072879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] [instance: df4a8b5b-4054-465a-81a5-1e3cd5b5997b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:22.078461 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:22.079063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:22.080412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:22.081218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:22.095960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] HTTP exception thrown: Instance df4a8b5b-4054-465a-81a5-1e3cd5b5997b could not be found. Dec 24 05:01:22.096581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Returning 404 to user: Instance df4a8b5b-4054-465a-81a5-1e3cd5b5997b could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:01:22.097420 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-edd41425-5f7d-4ff2-bddd-c59f242f910b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b" status: 404 len: 111 microversion: 2.1 time: 0.028386 Dec 24 05:01:22.097969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 249/458] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:22 2021] GET /compute/v2.1/servers/df4a8b5b-4054-465a-81a5-1e3cd5b5997b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:01:23.084101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:23.085171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:23.091321 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:23.091757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:23.092561 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:23.092992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:23.247336 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:23.255498 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.174950 Dec 24 05:01:23.256179 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 250/459] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:23 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:24.105820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cbbd1538-6923-4732-a42a-b604f6a013a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 2.366761 Dec 24 05:01:24.107179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 210/460] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:21 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:01:24.272366 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:24.272971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:24.279638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:24.280070 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:24.280866 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:24.281285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:24.418573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:24.426235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a114c092-da98-42f7-a6ec-3323fcba1e45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.157541 Dec 24 05:01:24.426799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 251/461] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:24 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:25.123665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2772476e-af59-4eca-ac4f-8520a735613f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:25.125319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2772476e-af59-4eca-ac4f-8520a735613f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:25.137019 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2772476e-af59-4eca-ac4f-8520a735613f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:25.137745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2772476e-af59-4eca-ac4f-8520a735613f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:25.139080 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2772476e-af59-4eca-ac4f-8520a735613f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:25.139780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2772476e-af59-4eca-ac4f-8520a735613f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:25.444813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:25.445467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:25.454065 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:25.454612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:25.455574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:25.456112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:25.597876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:25.605397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-19b8ba60-2c5c-4884-8163-00d41bc32dbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.165319 Dec 24 05:01:25.605996 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 252/462] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:25 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:26.625857 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:26.626987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:26.635945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:26.636700 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:26.637912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:26.638523 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:26.725596 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2772476e-af59-4eca-ac4f-8520a735613f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 1.608960 Dec 24 05:01:26.727286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 211/463] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:25 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:26.778689 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:26.788083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.168078 Dec 24 05:01:26.788880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 253/464] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:26 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:27.739049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-532680dc-3ed9-42f8-b595-dd209b0b7b2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:27.740589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-532680dc-3ed9-42f8-b595-dd209b0b7b2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:27.752761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-532680dc-3ed9-42f8-b595-dd209b0b7b2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:27.753270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-532680dc-3ed9-42f8-b595-dd209b0b7b2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:27.754055 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-532680dc-3ed9-42f8-b595-dd209b0b7b2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:27.754479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-532680dc-3ed9-42f8-b595-dd209b0b7b2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:27.809026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:27.810100 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:27.821245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:27.821984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:27.823277 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:27.823991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:27.960896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:27.969627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.166771 Dec 24 05:01:27.970765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 254/465] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:27 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:28.990702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:28.991836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:29.003124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:29.003853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:29.005346 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:29.005772 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:29.143632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:29.151492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-868bdc57-89f8-4ec8-9457-390432c4c317 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.167590 Dec 24 05:01:29.152048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 255/466] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:28 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:30.172151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:30.173217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:30.181798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:30.182238 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:30.183005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:30.183431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:30.315550 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:30.323981 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.157983 Dec 24 05:01:30.324550 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 256/467] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:30 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:31.341918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:31.342520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:31.349067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:31.349507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:31.350274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:31.350707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:31.492433 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:31.500152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.162029 Dec 24 05:01:31.500749 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 257/468] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:31 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:31.893710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-532680dc-3ed9-42f8-b595-dd209b0b7b2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 4.159042 Dec 24 05:01:31.894742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 212/469] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:27 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 4161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:32.520332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:32.521391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:32.528075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:32.528517 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:32.529305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:32.529725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:32.670705 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:32.678965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.164563 Dec 24 05:01:32.679519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 258/470] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:32 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:32.907263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-87bbf9aa-b310-49c5-9f66-b78cd2d04842 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:32.908914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-87bbf9aa-b310-49c5-9f66-b78cd2d04842 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:32.915974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-87bbf9aa-b310-49c5-9f66-b78cd2d04842 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:32.916414 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-87bbf9aa-b310-49c5-9f66-b78cd2d04842 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:32.917224 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-87bbf9aa-b310-49c5-9f66-b78cd2d04842 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:32.917653 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-87bbf9aa-b310-49c5-9f66-b78cd2d04842 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:33.027806 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-87bbf9aa-b310-49c5-9f66-b78cd2d04842 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.124450 Dec 24 05:01:33.032461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 213/471] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:32 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:33.696023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:33.696666 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:33.703952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:33.704440 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:33.705306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:33.705767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:33.776345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:33.777386 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:33.784416 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:33.784629 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:33.785379 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:33.785799 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:33.809321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lazy-loading 'flavor' on Instance uuid 27408900-d9e8-47e1-be4d-aac80e3f6fae {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:01:33.836168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:33.843779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c6e0114e-bb7b-45a9-a114-6a05edf1894d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.152095 Dec 24 05:01:33.844380 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 259/472] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:33 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:33.928228 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-074ea690-6e52-432f-9ca3-b52a2dcb8261 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action" status: 200 len: 32 microversion: 2.1 time: 0.156675 Dec 24 05:01:33.929162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 214/473] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:01:33 2021] POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:01:33.938078 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:33.938723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:33.945345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:33.945728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:33.946606 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:33.946956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:34.040242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-099a1bb4-57d1-4da1-8ca5-13354783ab11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:34.041349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-099a1bb4-57d1-4da1-8ca5-13354783ab11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:34.048681 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-099a1bb4-57d1-4da1-8ca5-13354783ab11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:34.049117 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-099a1bb4-57d1-4da1-8ca5-13354783ab11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:34.050133 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-099a1bb4-57d1-4da1-8ca5-13354783ab11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:34.050557 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-099a1bb4-57d1-4da1-8ca5-13354783ab11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:34.080116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:34.088834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.154365 Dec 24 05:01:34.089393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 260/474] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:33 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:34.865466 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:34.866732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:34.876942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:34.877667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:34.878919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:34.879664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:35.019424 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:35.031974 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f3d06457-dd06-4af4-a010-4c97eda5f1fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.173207 Dec 24 05:01:35.032818 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 261/475] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:34 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:35.106513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:35.107110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:35.113317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:35.113752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:35.114520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:35.114910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:35.248501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:35.256015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-14c2c38a-d635-453f-aaa9-85830ade1d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.153046 Dec 24 05:01:35.256548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 262/476] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:35 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:36.055442 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:36.056153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:36.063088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:36.063558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:36.064397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:36.064945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:36.202081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:36.210674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3a5aa92a-5918-408c-b131-a45525cd9440 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.160811 Dec 24 05:01:36.211240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 263/477] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:36 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:36.273521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:36.274130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:36.280160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:36.280814 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:36.281630 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:36.282072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:36.417494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:36.425341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-033d9da7-9b5f-4e1a-be77-4f024692aafa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.156002 Dec 24 05:01:36.425904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 264/478] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:36 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:36.430443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-2a7336a1-a513-41ba-8dbc-9218a0925e1f req-82cad4c0-40f4-4b09-a922-20fc488a81d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "name": "network-vif-plugged", "status": "completed", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:36.432114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:01:36.432114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:01:36.439526 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-2a7336a1-a513-41ba-8dbc-9218a0925e1f req-82cad4c0-40f4-4b09-a922-20fc488a81d3 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:36.440031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-2a7336a1-a513-41ba-8dbc-9218a0925e1f req-82cad4c0-40f4-4b09-a922-20fc488a81d3 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:36.450919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-2a7336a1-a513-41ba-8dbc-9218a0925e1f req-82cad4c0-40f4-4b09-a922-20fc488a81d3 service nova] Creating event network-vif-plugged:13f44c71-4981-48aa-bff5-6222de8d0cc1 for instance e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 on hv-cinder-81644 Dec 24 05:01:36.456127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-2a7336a1-a513-41ba-8dbc-9218a0925e1f req-82cad4c0-40f4-4b09-a922-20fc488a81d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029139 Dec 24 05:01:36.456810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 265/479] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:01:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:37.227973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:37.228710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:37.240960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:37.240960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:37.240960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:37.240960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:37.380588 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:37.388590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.165671 Dec 24 05:01:37.389124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 266/480] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:37 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:37.444716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:37.445525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:37.453605 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:37.454079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:37.455075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:37.455612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:37.589934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:37.597446 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b9843abd-9863-4f3d-86bb-49fd860292c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.157598 Dec 24 05:01:37.598013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 267/481] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:37 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:37.827923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-099a1bb4-57d1-4da1-8ca5-13354783ab11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 3.792058 Dec 24 05:01:37.828958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 215/482] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:34 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 3794 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:38.407064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:38.407719 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:38.415787 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:38.416337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:38.417370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:38.417898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:38.555111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:38.562408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.160116 Dec 24 05:01:38.562971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 268/483] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:38 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:38.615403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:38.616122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:38.623270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:38.623707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:38.624474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:38.624925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:38.767079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:38.775896 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.164485 Dec 24 05:01:38.776466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 216/484] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:38 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:38.843795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0ec2324e-a098-4a96-b155-469a9dc506e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:38.845321 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0ec2324e-a098-4a96-b155-469a9dc506e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:38.854374 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ec2324e-a098-4a96-b155-469a9dc506e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:38.854817 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ec2324e-a098-4a96-b155-469a9dc506e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:38.855584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ec2324e-a098-4a96-b155-469a9dc506e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:38.856014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ec2324e-a098-4a96-b155-469a9dc506e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:39.205102 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0ec2324e-a098-4a96-b155-469a9dc506e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.367126 Dec 24 05:01:39.205762 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 269/485] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:38 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:39.583180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:39.584173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:39.595432 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:39.596184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:39.597551 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:39.598228 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:39.730219 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:39.737487 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fa9124be-74a7-4221-ac1d-6790fe3924e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.160373 Dec 24 05:01:39.738065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 217/486] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:39 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:39.794714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:39.795539 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:39.803915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:39.804378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:39.805286 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:39.805720 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:39.953328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:39.961790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-518da218-6de0-4090-a519-1e8649d6c3fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.171547 Dec 24 05:01:39.962356 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 270/487] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:39 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:40.217628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2bf19f09-295b-4b5a-9e33-000621e2de22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:40.218513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2bf19f09-295b-4b5a-9e33-000621e2de22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:40.225649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2bf19f09-295b-4b5a-9e33-000621e2de22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:40.226106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2bf19f09-295b-4b5a-9e33-000621e2de22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:40.227435 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2bf19f09-295b-4b5a-9e33-000621e2de22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:40.227861 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2bf19f09-295b-4b5a-9e33-000621e2de22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:40.754566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:40.755174 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:40.762372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:40.762819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:40.763584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:40.764015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:40.911337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:40.918942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7e8488c9-ba5c-4974-be69-a31db61502cc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.167988 Dec 24 05:01:40.919531 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 271/488] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:40 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:40.979537 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:40.980230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:40.988232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:40.988879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:40.989913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:40.990482 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:41.131939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:41.140394 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-968640f6-c54b-46b4-bc78-0bf447cb9a93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.165226 Dec 24 05:01:41.141044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 272/489] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:40 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:41.940159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:41.941360 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:41.952120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:41.952981 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:41.954219 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:41.954932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:42.092897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:42.100859 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.166925 Dec 24 05:01:42.101426 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 273/490] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:41 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:42.161119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:42.162102 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:42.173470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:42.174391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:42.175935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:42.176992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:42.319697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:42.328932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eb7ae1c5-d792-449d-886a-5d64725f8164 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.173744 Dec 24 05:01:42.329553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 274/491] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:42 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:43.121171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:43.122287 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:43.132812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:43.133549 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:43.134821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:43.135412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:43.287721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:43.297205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-876d0371-f407-45a5-99a3-03508aa2bef1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.182261 Dec 24 05:01:43.297735 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 275/492] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:43 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:43.350615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:43.351630 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:43.363025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:43.363863 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:43.365381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:43.366160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:43.507849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:43.519395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dea7e973-5148-440c-a23f-e5dbd77661ca tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.175231 Dec 24 05:01:43.520195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 276/493] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:43 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:44.064198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2bf19f09-295b-4b5a-9e33-000621e2de22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 3.849893 Dec 24 05:01:44.065649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 218/494] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:40 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 3853 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:44.317552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:44.318492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:44.329518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:44.330246 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:44.331546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:44.332249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:44.472973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:44.482612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.171184 Dec 24 05:01:44.483171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 277/495] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:44 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:44.541022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:44.541942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:44.549107 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:44.549541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:44.550301 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:44.550723 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:44.683755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:44.691854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-14e1f496-4946-4fde-9aae-4422b8662046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.157492 Dec 24 05:01:44.692385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 219/496] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:44 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:45.078895 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-13167f9b-a048-486b-8062-3e4a0504accd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:45.079907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-13167f9b-a048-486b-8062-3e4a0504accd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:45.086737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13167f9b-a048-486b-8062-3e4a0504accd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:45.087182 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13167f9b-a048-486b-8062-3e4a0504accd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:45.088185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13167f9b-a048-486b-8062-3e4a0504accd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:45.088666 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13167f9b-a048-486b-8062-3e4a0504accd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:45.204868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-13167f9b-a048-486b-8062-3e4a0504accd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.129488 Dec 24 05:01:45.205407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 278/497] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:45 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:45.499794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:45.500422 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:45.506928 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:45.507383 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:45.508155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:45.508722 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:45.658804 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:45.666487 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1317 microversion: 2.1 time: 0.170447 Dec 24 05:01:45.667694 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 220/498] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:45 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:45.710125 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:45.710806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:45.718577 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:45.718957 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:45.719743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:45.720167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:45.859532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:45.868680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0b37185e-51e2-4ad0-afcf-43f156456595 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.162951 Dec 24 05:01:45.869524 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 279/499] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:45 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:46.217103 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9e188724-028d-4964-be93-7312e1dc8560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:46.218008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9e188724-028d-4964-be93-7312e1dc8560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:46.224584 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e188724-028d-4964-be93-7312e1dc8560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:46.225051 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e188724-028d-4964-be93-7312e1dc8560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:46.225816 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e188724-028d-4964-be93-7312e1dc8560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:46.226312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e188724-028d-4964-be93-7312e1dc8560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:46.327636 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9e188724-028d-4964-be93-7312e1dc8560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.114074 Dec 24 05:01:46.328449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 221/500] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:46 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:46.683558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:46.684305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:46.690673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:46.691133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:46.691899 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:46.692327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:46.829753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:46.837829 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f54a48c4-725a-4762-9383-506d1a3f6fef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1507 microversion: 2.1 time: 0.158288 Dec 24 05:01:46.838638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 280/501] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:46 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:46.887088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:46.887795 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:46.895154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:46.895599 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:46.896393 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:46.896855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:47.040683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:47.052484 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-32150eab-fb8d-42e5-a386-f17d7e8a3499 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.169904 Dec 24 05:01:47.064284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 222/502] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:46 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:47.339800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b71c3f31-52a0-4de6-afd7-b7593b6e404d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:47.340739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b71c3f31-52a0-4de6-afd7-b7593b6e404d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:47.347937 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b71c3f31-52a0-4de6-afd7-b7593b6e404d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:47.348454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b71c3f31-52a0-4de6-afd7-b7593b6e404d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:47.349269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b71c3f31-52a0-4de6-afd7-b7593b6e404d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:47.349808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b71c3f31-52a0-4de6-afd7-b7593b6e404d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:48.071922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:48.072658 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:48.079853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:48.080502 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:48.081338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:48.081990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:48.225911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:48.235141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-50d538ee-0633-43f0-b35a-2aa00d78b04f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.167712 Dec 24 05:01:48.235802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 223/503] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:48 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:48.763681 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b71c3f31-52a0-4de6-afd7-b7593b6e404d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 1.427193 Dec 24 05:01:48.764313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 281/504] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:47 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:49.254692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:49.255358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:49.264132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:49.264815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:49.265943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:49.266655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:49.413267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:49.422345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.172885 Dec 24 05:01:49.423272 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 224/505] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:49 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:49.776431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e4779817-dc2c-460e-9567-904ba8e13f66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:49.776938 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e4779817-dc2c-460e-9567-904ba8e13f66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:49.783593 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e4779817-dc2c-460e-9567-904ba8e13f66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:49.784060 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e4779817-dc2c-460e-9567-904ba8e13f66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:49.784939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e4779817-dc2c-460e-9567-904ba8e13f66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:49.785389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e4779817-dc2c-460e-9567-904ba8e13f66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:50.439147 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:50.439716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:50.446441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:50.446878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:50.448013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:50.448443 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:50.822841 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:50.830562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.395164 Dec 24 05:01:50.831243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 225/506] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:50 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:51.388776 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e4779817-dc2c-460e-9567-904ba8e13f66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 1.616807 Dec 24 05:01:51.393457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 282/507] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:49 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:51.848284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:51.849654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:51.856982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:51.858308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:51.859788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:51.860511 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:52.035013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:52.045886 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.201368 Dec 24 05:01:52.046929 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 226/508] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:51 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:52.405704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4e299e74-ed4b-4af6-87e3-6f984868217e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:52.407434 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4e299e74-ed4b-4af6-87e3-6f984868217e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:52.416936 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e299e74-ed4b-4af6-87e3-6f984868217e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:52.417816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e299e74-ed4b-4af6-87e3-6f984868217e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:52.425423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e299e74-ed4b-4af6-87e3-6f984868217e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:52.425972 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e299e74-ed4b-4af6-87e3-6f984868217e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:52.525076 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4e299e74-ed4b-4af6-87e3-6f984868217e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.125255 Dec 24 05:01:52.530215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 283/509] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:52 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:53.067440 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:53.069297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:53.094984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:53.095300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:53.098680 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:53.107465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:53.358083 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:53.386737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e40bf9fc-6102-4069-b73f-c63d8d201b71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.324644 Dec 24 05:01:53.389636 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 227/510] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:53 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:53.543159 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-071ab0fe-16fe-42ce-9ec9-39c2cad38d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:53.544220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-071ab0fe-16fe-42ce-9ec9-39c2cad38d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:53.546171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ee660199-7f41-42b7-a683-d262ff50645c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de74d1f-e87a-4d46-944d-bc4c9369decc"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:53.547708 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ee660199-7f41-42b7-a683-d262ff50645c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:53.561465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-071ab0fe-16fe-42ce-9ec9-39c2cad38d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:53.573247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-071ab0fe-16fe-42ce-9ec9-39c2cad38d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:53.577240 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-071ab0fe-16fe-42ce-9ec9-39c2cad38d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:53.577791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee660199-7f41-42b7-a683-d262ff50645c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:53.578328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-071ab0fe-16fe-42ce-9ec9-39c2cad38d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:53.579566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee660199-7f41-42b7-a683-d262ff50645c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:53.582820 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee660199-7f41-42b7-a683-d262ff50645c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:53.582820 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ee660199-7f41-42b7-a683-d262ff50645c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:53.717778 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-071ab0fe-16fe-42ce-9ec9-39c2cad38d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.177920 Dec 24 05:01:53.718432 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 228/511] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:53 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:54.337331 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ee660199-7f41-42b7-a683-d262ff50645c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.804080 Dec 24 05:01:54.343823 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 284/512] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:01:53 2021] POST /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:01:54.408147 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:54.408930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:54.421590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:54.422102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:54.424965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:54.426869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:54.582530 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:54.590178 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.187263 Dec 24 05:01:54.590742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 229/513] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:54 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:54.730886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3ea4c37c-b3fa-43a4-bf3b-8322bc8b7847 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:54.732155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3ea4c37c-b3fa-43a4-bf3b-8322bc8b7847 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:54.739005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ea4c37c-b3fa-43a4-bf3b-8322bc8b7847 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:54.739697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ea4c37c-b3fa-43a4-bf3b-8322bc8b7847 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:54.740568 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ea4c37c-b3fa-43a4-bf3b-8322bc8b7847 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:54.741152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ea4c37c-b3fa-43a4-bf3b-8322bc8b7847 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:54.840625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3ea4c37c-b3fa-43a4-bf3b-8322bc8b7847 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.114379 Dec 24 05:01:54.841253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 285/514] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:54 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:55.607075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:55.607704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:55.614421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:55.614943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:55.615734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:55.616160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:55.758525 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:55.766340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.163042 Dec 24 05:01:55.766904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 230/515] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:55 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:55.853782 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3002abf4-dd31-4676-bf98-b471b903ec0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:55.855454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3002abf4-dd31-4676-bf98-b471b903ec0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:55.864431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3002abf4-dd31-4676-bf98-b471b903ec0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:55.864940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3002abf4-dd31-4676-bf98-b471b903ec0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:55.865978 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3002abf4-dd31-4676-bf98-b471b903ec0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:55.866492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3002abf4-dd31-4676-bf98-b471b903ec0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:55.985036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3002abf4-dd31-4676-bf98-b471b903ec0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 0.135208 Dec 24 05:01:55.986491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 286/516] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:55 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:01:56.783544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:56.785005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:56.796764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:56.797218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:56.798019 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:56.798453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:56.956662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:56.966410 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.186895 Dec 24 05:01:56.967610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 231/517] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:56 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:01:56.999725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-043fd453-ce64-466f-af45-ec95d0ba7de3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:01:57.001963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-043fd453-ce64-466f-af45-ec95d0ba7de3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:57.009109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-043fd453-ce64-466f-af45-ec95d0ba7de3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:57.009876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-043fd453-ce64-466f-af45-ec95d0ba7de3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:57.011428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-043fd453-ce64-466f-af45-ec95d0ba7de3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:57.012070 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-043fd453-ce64-466f-af45-ec95d0ba7de3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:57.988149 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:57.988843 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:57.999239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:57.999968 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:58.001297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:58.002029 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:58.145451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:58.152963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8759c0c1-8176-4bac-b80c-a8969b125c98 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.171421 Dec 24 05:01:58.153533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 232/518] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:57 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:01:59.170322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:01:59.170930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:01:59.179927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:59.180485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:59.181320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:01:59.183966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:01:59.358162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:01:59.365502 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2b46c215-711e-4642-85bc-fb35a4a67647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.199010 Dec 24 05:01:59.366562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 233/519] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:01:59 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:00.387718 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:00.388366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:00.395171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:00.395607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:00.396367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:00.396863 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:00.549784 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:00.557520 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.174634 Dec 24 05:02:00.558379 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 234/520] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:00 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:00.810845 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-043fd453-ce64-466f-af45-ec95d0ba7de3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28163 microversion: 2.20 time: 3.816546 Dec 24 05:02:00.816032 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 287/521] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:01:56 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28163 bytes in 3823 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:01.575989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:01.578280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:01.587008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:01.587598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:01.588717 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:01.589462 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:01.757950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:01.766158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a59f03ce-0353-4988-8621-9f3c427ba145 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.195448 Dec 24 05:02:01.767322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 235/522] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:01 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:01.826109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e3fff3c6-ea11-43f8-8a2e-27e386130501 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:01.835892 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e3fff3c6-ea11-43f8-8a2e-27e386130501 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:01.843766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3fff3c6-ea11-43f8-8a2e-27e386130501 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:01.844213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3fff3c6-ea11-43f8-8a2e-27e386130501 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:01.845040 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3fff3c6-ea11-43f8-8a2e-27e386130501 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:01.845552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3fff3c6-ea11-43f8-8a2e-27e386130501 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:02.236020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e3fff3c6-ea11-43f8-8a2e-27e386130501 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28392 microversion: 2.20 time: 0.414011 Dec 24 05:02:02.239973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 288/523] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:01 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28392 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:02.787028 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:02.788158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:02.796995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:02.797423 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:02.798392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:02.798830 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:02.947444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:02.955627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.174623 Dec 24 05:02:02.956374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 236/524] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:02 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:03.250217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-69d17128-6bed-413d-a2ae-490829c021bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:03.251620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-69d17128-6bed-413d-a2ae-490829c021bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:03.261084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69d17128-6bed-413d-a2ae-490829c021bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:03.261522 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69d17128-6bed-413d-a2ae-490829c021bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:03.262475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69d17128-6bed-413d-a2ae-490829c021bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:03.262897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69d17128-6bed-413d-a2ae-490829c021bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:03.460429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-69d17128-6bed-413d-a2ae-490829c021bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28454 microversion: 2.20 time: 0.214635 Dec 24 05:02:03.461389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 289/525] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:03 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28454 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:03.972893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:03.973699 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:03.980517 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:03.981097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:03.981963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:03.982463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.150961 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:04.158975 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-72930da6-b034-447c-bcd2-f76b15a532e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1500 microversion: 2.1 time: 0.189670 Dec 24 05:02:04.159574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 237/526] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:03 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:04.181350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46d2a459-95da-4ae3-a27d-526c2b745454"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:04.183286 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:04.190143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.190572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.191345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.191776 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.217722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] HTTP exception thrown: Cannot 'attach_volume' instance 27408900-d9e8-47e1-be4d-aac80e3f6fae while it is in vm_state rescued Dec 24 05:02:04.218301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Returning 409 to user: Cannot 'attach_volume' instance 27408900-d9e8-47e1-be4d-aac80e3f6fae while it is in vm_state rescued {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:02:04.219145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-91dd7f2a-5ace-41aa-8112-89cbbbefa093 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042009 Dec 24 05:02:04.219681 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 290/527] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:02:04 2021] POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 24 05:02:04.228036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-50838218-6882-444b-9a4f-b3ccfedc0769 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:04.228665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-50838218-6882-444b-9a4f-b3ccfedc0769 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:04.235334 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50838218-6882-444b-9a4f-b3ccfedc0769 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.235992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50838218-6882-444b-9a4f-b3ccfedc0769 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.236876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50838218-6882-444b-9a4f-b3ccfedc0769 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.237303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50838218-6882-444b-9a4f-b3ccfedc0769 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.305854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-50838218-6882-444b-9a4f-b3ccfedc0769 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action" status: 202 len: 0 microversion: 2.1 time: 0.081200 Dec 24 05:02:04.308184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 238/528] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:02:04 2021] POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:04.316336 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:04.317627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:04.324686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.325166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.325961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.326371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.473100 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-977b2824-5be9-477b-a660-21f367764a9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:04.474442 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-977b2824-5be9-477b-a660-21f367764a9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:04.481984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:04.483049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-977b2824-5be9-477b-a660-21f367764a9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.484160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-977b2824-5be9-477b-a660-21f367764a9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.485165 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-977b2824-5be9-477b-a660-21f367764a9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:04.485834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-977b2824-5be9-477b-a660-21f367764a9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:04.494716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1508 microversion: 2.1 time: 0.181893 Dec 24 05:02:04.497782 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 291/529] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:04 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:04.625930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-977b2824-5be9-477b-a660-21f367764a9c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28454 microversion: 2.20 time: 0.156878 Dec 24 05:02:04.627011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 239/530] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:04 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:05.517988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:05.519191 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:05.527784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:05.528594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:05.529640 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:05.530281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:05.642363 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-629b7ae0-1b83-4c55-926a-b92558c3c8bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:05.644150 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-629b7ae0-1b83-4c55-926a-b92558c3c8bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:05.658933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-629b7ae0-1b83-4c55-926a-b92558c3c8bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:05.659481 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-629b7ae0-1b83-4c55-926a-b92558c3c8bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:05.661018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-629b7ae0-1b83-4c55-926a-b92558c3c8bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:05.661669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-629b7ae0-1b83-4c55-926a-b92558c3c8bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:05.703142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:05.714254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-db6e2555-2565-452f-aea9-fb104cefbeef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1508 microversion: 2.1 time: 0.200302 Dec 24 05:02:05.715191 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 292/531] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:05 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:05.879016 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-629b7ae0-1b83-4c55-926a-b92558c3c8bd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28620 microversion: 2.20 time: 0.243898 Dec 24 05:02:05.883462 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 240/532] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:05 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28620 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:06.733216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:06.735953 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:06.746750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:06.747753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:06.749076 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:06.749861 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:06.892199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-81dff1b6-a32b-491c-ac35-2cbfd20a772d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:06.895757 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-81dff1b6-a32b-491c-ac35-2cbfd20a772d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:06.903563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81dff1b6-a32b-491c-ac35-2cbfd20a772d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:06.904577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81dff1b6-a32b-491c-ac35-2cbfd20a772d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:06.905674 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81dff1b6-a32b-491c-ac35-2cbfd20a772d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:06.906412 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81dff1b6-a32b-491c-ac35-2cbfd20a772d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:06.937030 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:06.959275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c6eb3515-4a70-4ce8-8f32-573f616819c6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1508 microversion: 2.1 time: 0.231097 Dec 24 05:02:06.964266 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 293/533] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:06 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:07.047975 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-81dff1b6-a32b-491c-ac35-2cbfd20a772d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.159694 Dec 24 05:02:07.052841 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 241/534] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:06 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:07.983662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:07.984378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:07.994677 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:07.995527 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:07.996295 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:07.996758 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:08.060546 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f72c969b-afa5-4988-a651-eca1df1421f0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:08.061621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f72c969b-afa5-4988-a651-eca1df1421f0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:08.071154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f72c969b-afa5-4988-a651-eca1df1421f0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:08.071933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f72c969b-afa5-4988-a651-eca1df1421f0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:08.073138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f72c969b-afa5-4988-a651-eca1df1421f0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:08.073915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f72c969b-afa5-4988-a651-eca1df1421f0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:08.210176 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f72c969b-afa5-4988-a651-eca1df1421f0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.153494 Dec 24 05:02:08.215585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 242/535] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:08 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:08.264483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:08.274779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9305e53a-213f-4867-a2a0-14fe6f255318 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1508 microversion: 2.1 time: 0.295737 Dec 24 05:02:08.286632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 294/536] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:07 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:09.224669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-819a01ce-38c7-4083-888d-276228b9089b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:09.225893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-819a01ce-38c7-4083-888d-276228b9089b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:09.240070 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-819a01ce-38c7-4083-888d-276228b9089b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:09.242566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-819a01ce-38c7-4083-888d-276228b9089b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:09.250068 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-819a01ce-38c7-4083-888d-276228b9089b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:09.251121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-819a01ce-38c7-4083-888d-276228b9089b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:09.297981 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:09.298680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:09.344943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:09.345412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:09.346225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:09.346661 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:09.437178 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-819a01ce-38c7-4083-888d-276228b9089b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.217545 Dec 24 05:02:09.438233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 243/537] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:09 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:09.548316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:09.555730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e7102452-4741-4376-b1e8-41c61be40ec1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1514 microversion: 2.1 time: 0.264293 Dec 24 05:02:09.568361 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 295/538] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:09 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:10.238021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de74d1f-e87a-4d46-944d-bc4c9369decc"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:10.239347 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:10.246373 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.246811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.247585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.248007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.373204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] HTTP exception thrown: Invalid volume: volume 5de74d1f-e87a-4d46-944d-bc4c9369decc is already attached to instances: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 Dec 24 05:02:10.374138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Returning 400 to user: Invalid volume: volume 5de74d1f-e87a-4d46-944d-bc4c9369decc is already attached to instances: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:02:10.375701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-851ca4f6-c279-4f71-94fd-3a380d043fa3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142849 Dec 24 05:02:10.376625 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 244/539] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:02:10 2021] POST /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments => generated 174 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 24 05:02:10.457468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-58d9e244-9101-4052-b8ae-ddbaa8ad5ab4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:10.458007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:10.458466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:10.461119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-58d9e244-9101-4052-b8ae-ddbaa8ad5ab4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:10.468028 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.471017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.472345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.473871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58d9e244-9101-4052-b8ae-ddbaa8ad5ab4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.476922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.477594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58d9e244-9101-4052-b8ae-ddbaa8ad5ab4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.478582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58d9e244-9101-4052-b8ae-ddbaa8ad5ab4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.479709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58d9e244-9101-4052-b8ae-ddbaa8ad5ab4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.586790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-58d9e244-9101-4052-b8ae-ddbaa8ad5ab4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.140735 Dec 24 05:02:10.587788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 296/540] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:10 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:10.631851 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'services' on Instance uuid e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:02:10.711219 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-15e32516-e82d-4948-b800-ebd44aebfb4d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments/5de74d1f-e87a-4d46-944d-bc4c9369decc" status: 202 len: 0 microversion: 2.1 time: 0.261841 Dec 24 05:02:10.711984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 245/541] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:02:10 2021] DELETE /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments/5de74d1f-e87a-4d46-944d-bc4c9369decc => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:10.720598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b0b1aa33-a5b4-4de8-8aef-7481c33c2b7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:10.721801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b0b1aa33-a5b4-4de8-8aef-7481c33c2b7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:10.729622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0b1aa33-a5b4-4de8-8aef-7481c33c2b7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.730465 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0b1aa33-a5b4-4de8-8aef-7481c33c2b7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.731480 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0b1aa33-a5b4-4de8-8aef-7481c33c2b7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:10.732092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0b1aa33-a5b4-4de8-8aef-7481c33c2b7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:10.766291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b0b1aa33-a5b4-4de8-8aef-7481c33c2b7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049664 Dec 24 05:02:10.767521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 297/542] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:02:10 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:11.600644 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bfb3ef66-f509-4b47-82a6-ecc5b283ad8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:11.601901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bfb3ef66-f509-4b47-82a6-ecc5b283ad8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:11.610527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bfb3ef66-f509-4b47-82a6-ecc5b283ad8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:11.611223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bfb3ef66-f509-4b47-82a6-ecc5b283ad8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:11.612263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bfb3ef66-f509-4b47-82a6-ecc5b283ad8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:11.612730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bfb3ef66-f509-4b47-82a6-ecc5b283ad8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:11.724914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bfb3ef66-f509-4b47-82a6-ecc5b283ad8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.128762 Dec 24 05:02:11.725572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 246/543] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:11 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:11.778496 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fb6d9964-567b-4284-a093-5a96730f036a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:11.779295 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fb6d9964-567b-4284-a093-5a96730f036a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:11.786205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb6d9964-567b-4284-a093-5a96730f036a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:11.786648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb6d9964-567b-4284-a093-5a96730f036a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:11.787407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb6d9964-567b-4284-a093-5a96730f036a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:11.787829 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb6d9964-567b-4284-a093-5a96730f036a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:11.827057 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fb6d9964-567b-4284-a093-5a96730f036a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052594 Dec 24 05:02:11.827619 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 298/544] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:02:11 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:12.135958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:12.136956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:12.144742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.145472 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.146339 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.146873 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.294671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:12.302189 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3b2f9c11-947b-44da-a117-1705eb98b046 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1514 microversion: 2.1 time: 0.170884 Dec 24 05:02:12.302928 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 247/545] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:12 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:12.320195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-98cea384-26c7-4e1b-a659-d9e880ce7a00 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "931dfc1a-ccc6-4d07-80e6-33faba1e3135"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:12.322021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-98cea384-26c7-4e1b-a659-d9e880ce7a00 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:12.328735 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98cea384-26c7-4e1b-a659-d9e880ce7a00 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.329182 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98cea384-26c7-4e1b-a659-d9e880ce7a00 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.329972 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98cea384-26c7-4e1b-a659-d9e880ce7a00 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.330463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-98cea384-26c7-4e1b-a659-d9e880ce7a00 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.659544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-98cea384-26c7-4e1b-a659-d9e880ce7a00 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342855 Dec 24 05:02:12.666147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 299/546] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:02:12 2021] POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:12.738095 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d82d134b-2dc5-42aa-b2a4-a350dce9e502 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:12.739033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d82d134b-2dc5-42aa-b2a4-a350dce9e502 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:12.749543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d82d134b-2dc5-42aa-b2a4-a350dce9e502 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.754288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d82d134b-2dc5-42aa-b2a4-a350dce9e502 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.755129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d82d134b-2dc5-42aa-b2a4-a350dce9e502 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.755556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d82d134b-2dc5-42aa-b2a4-a350dce9e502 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.842268 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-99e2c3ee-a0de-4c58-93ed-8b534e31bbc3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:12.845412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-99e2c3ee-a0de-4c58-93ed-8b534e31bbc3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:12.857103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99e2c3ee-a0de-4c58-93ed-8b534e31bbc3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.857682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99e2c3ee-a0de-4c58-93ed-8b534e31bbc3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.858786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99e2c3ee-a0de-4c58-93ed-8b534e31bbc3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:12.859746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-99e2c3ee-a0de-4c58-93ed-8b534e31bbc3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:12.906502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-99e2c3ee-a0de-4c58-93ed-8b534e31bbc3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069929 Dec 24 05:02:12.907290 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 300/547] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:02:12 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 05:02:12.943402 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d82d134b-2dc5-42aa-b2a4-a350dce9e502 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.208817 Dec 24 05:02:12.944398 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 248/548] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:12 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:13.092183 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-234649597", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "b92a87f3-957a-4ccb-9b5b-98ad92aebe6e"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:13.958537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8705b2fa-eb52-4893-98ad-a9001fd9e3e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:13.959527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8705b2fa-eb52-4893-98ad-a9001fd9e3e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:13.969375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8705b2fa-eb52-4893-98ad-a9001fd9e3e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:13.969811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8705b2fa-eb52-4893-98ad-a9001fd9e3e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:13.971162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8705b2fa-eb52-4893-98ad-a9001fd9e3e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:13.971868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8705b2fa-eb52-4893-98ad-a9001fd9e3e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:14.082061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8705b2fa-eb52-4893-98ad-a9001fd9e3e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.129441 Dec 24 05:02:14.082663 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 249/549] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:13 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:15.095173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-49881a11-bf34-449c-922c-8cf82c3d1cb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:15.096170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-49881a11-bf34-449c-922c-8cf82c3d1cb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:15.105163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49881a11-bf34-449c-922c-8cf82c3d1cb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:15.107737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49881a11-bf34-449c-922c-8cf82c3d1cb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:15.109751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49881a11-bf34-449c-922c-8cf82c3d1cb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:15.110393 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49881a11-bf34-449c-922c-8cf82c3d1cb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:15.270102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-49881a11-bf34-449c-922c-8cf82c3d1cb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.179021 Dec 24 05:02:15.271061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 250/550] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:15 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:16.283549 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e1a90536-cf95-46bc-8283-ab912f3424d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:16.284581 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e1a90536-cf95-46bc-8283-ab912f3424d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:16.292872 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1a90536-cf95-46bc-8283-ab912f3424d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:16.293563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1a90536-cf95-46bc-8283-ab912f3424d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:16.294559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1a90536-cf95-46bc-8283-ab912f3424d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:16.294971 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1a90536-cf95-46bc-8283-ab912f3424d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:16.422344 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e1a90536-cf95-46bc-8283-ab912f3424d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.143052 Dec 24 05:02:16.426464 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 251/551] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:16 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:17.420488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] validate_networks() for [('b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:02:17.438163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fe050d21-3e96-4f76-918a-7ef36c9319a4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:17.440044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fe050d21-3e96-4f76-918a-7ef36c9319a4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:17.454718 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe050d21-3e96-4f76-918a-7ef36c9319a4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:17.455154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe050d21-3e96-4f76-918a-7ef36c9319a4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:17.455932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe050d21-3e96-4f76-918a-7ef36c9319a4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:17.456352 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe050d21-3e96-4f76-918a-7ef36c9319a4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:17.581277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fe050d21-3e96-4f76-918a-7ef36c9319a4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.146968 Dec 24 05:02:17.581943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 252/552] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:17 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:17.968392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:02:17.968858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:02:17.969328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:02:17.969702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:02:17.970105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:02:17.979186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:17.979632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:17.980443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:17.980918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:17.998165 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:02:18.002935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Getting quotas for user f29f576d3a98449b8077c0df53968f07 and project 8f1c3a94f02049e3a76c4fc01fa7a022. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:02:18.015042 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:02:18.017528 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:02:18.062297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.974119 Dec 24 05:02:18.062980 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 301/553] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:02:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 4976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:02:18.074847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-428f9e19-6992-40da-9cda-149be90cce70 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:18.075548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-428f9e19-6992-40da-9cda-149be90cce70 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:18.131200 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-428f9e19-6992-40da-9cda-149be90cce70 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:18.138730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-428f9e19-6992-40da-9cda-149be90cce70 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1217 microversion: 2.1 time: 0.068615 Dec 24 05:02:18.139288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 253/554] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:18 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:18.595993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cd604a1d-f49c-4819-b2e5-7214b71b8bc3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:18.598392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cd604a1d-f49c-4819-b2e5-7214b71b8bc3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:18.605108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd604a1d-f49c-4819-b2e5-7214b71b8bc3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:18.605961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd604a1d-f49c-4819-b2e5-7214b71b8bc3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:18.607197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd604a1d-f49c-4819-b2e5-7214b71b8bc3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:18.607819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd604a1d-f49c-4819-b2e5-7214b71b8bc3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:18.675037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1763719286", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:18.751532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cd604a1d-f49c-4819-b2e5-7214b71b8bc3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.161173 Dec 24 05:02:18.752168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 302/555] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:18 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:19.156291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:19.157080 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:19.160146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] validate_networks() for None {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:02:19.173733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:19.174176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:19.175168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:19.175874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:19.254485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:19.264960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-79bb6746-cf55-4c8c-a219-c7d01a2be0de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1269 microversion: 2.1 time: 0.113248 Dec 24 05:02:19.265505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 303/556] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:19 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:19.526069 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:02:19.526601 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:02:19.527381 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:02:19.528051 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:02:19.536786 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:02:19.545795 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:19.546669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:19.547843 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:19.548340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:19.568389 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Getting quotas for project aad82f86c5b5403799701feca92f316e. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:02:19.573388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Getting quotas for user a777bab1007446e3bdcf9332119a2c9e and project aad82f86c5b5403799701feca92f316e. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:02:19.585227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:02:19.587720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:02:19.643432 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972532 Dec 24 05:02:19.644292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 254/557] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:02:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 24 05:02:19.654020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a2ec2587-ae51-4640-aebd-5ed7e1751cf5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:19.654779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a2ec2587-ae51-4640-aebd-5ed7e1751cf5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:19.708826 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a2ec2587-ae51-4640-aebd-5ed7e1751cf5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:19.717174 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a2ec2587-ae51-4640-aebd-5ed7e1751cf5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1215 microversion: 2.1 time: 0.066815 Dec 24 05:02:19.717747 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 304/558] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:19 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:19.764316 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0b287f88-1c0d-4418-b781-6408d67aea7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:19.765429 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0b287f88-1c0d-4418-b781-6408d67aea7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:19.785207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b287f88-1c0d-4418-b781-6408d67aea7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:19.785878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b287f88-1c0d-4418-b781-6408d67aea7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:19.786881 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b287f88-1c0d-4418-b781-6408d67aea7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:19.790775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b287f88-1c0d-4418-b781-6408d67aea7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:19.954916 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0b287f88-1c0d-4418-b781-6408d67aea7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.194762 Dec 24 05:02:19.955950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 255/559] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:19 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:20.281610 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:20.282231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:20.301385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:20.301843 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:20.302883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:20.303491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:20.529626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:20.537132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.258959 Dec 24 05:02:20.537645 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 305/560] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:20 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:20.734667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:20.735640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:20.744069 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:20.744591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:20.745724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:20.746246 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:20.838355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:20.846908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e3abf692-088a-4f53-b8f8-72636a39563e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1267 microversion: 2.1 time: 0.116156 Dec 24 05:02:20.847507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 256/561] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:20 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:20.968761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b647c390-8300-494b-af18-916e55e86324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:20.976904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b647c390-8300-494b-af18-916e55e86324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:20.981405 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b647c390-8300-494b-af18-916e55e86324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:20.981971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b647c390-8300-494b-af18-916e55e86324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:20.983002 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b647c390-8300-494b-af18-916e55e86324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:20.983510 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b647c390-8300-494b-af18-916e55e86324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.018392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-fd056d72-4ad4-4649-a075-bc9e59949c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:21.022483 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:21.022483 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:02:21.039992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-fd056d72-4ad4-4649-a075-bc9e59949c67 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.040539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-fd056d72-4ad4-4649-a075-bc9e59949c67 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.055801 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-fd056d72-4ad4-4649-a075-bc9e59949c67 service nova] Creating event network-changed:7484fcf7-0384-4cf4-8974-7df317686b39 for instance 6e67ec17-823b-4612-8bd4-dbe278717d5e on hv-cinder-81644 Dec 24 05:02:21.058537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-fd056d72-4ad4-4649-a075-bc9e59949c67 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048500 Dec 24 05:02:21.059654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 257/562] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:02:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:02:21.239818 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b647c390-8300-494b-af18-916e55e86324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.275419 Dec 24 05:02:21.241113 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 306/563] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:20 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:21.242216 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:21.243220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:21.249547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.250336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.250752 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.251171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.277584 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lazy-loading 'flavor' on Instance uuid 27408900-d9e8-47e1-be4d-aac80e3f6fae {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:02:21.432038 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a6afb449-6d9a-401b-b762-27300b29c53b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action" status: 200 len: 32 microversion: 2.1 time: 0.194107 Dec 24 05:02:21.433128 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 258/564] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:02:21 2021] POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 24 05:02:21.443509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:21.444780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:21.455923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.467325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.469454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.470334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.556333 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:21.557103 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:21.567055 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.567498 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.569674 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.570284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.661458 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:21.682948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.234834 Dec 24 05:02:21.685096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 307/565] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:21 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:21.862633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:21.863236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:21.869840 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.870346 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.871332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:21.871725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:21.941898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:21.949211 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bcbce21b-f1a5-4afc-be63-ea04ba917519 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1273 microversion: 2.1 time: 0.090076 Dec 24 05:02:21.950034 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 308/566] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:21 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:22.253998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2ef80f3b-f195-42d7-9616-45240468c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:22.255010 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2ef80f3b-f195-42d7-9616-45240468c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:22.261353 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ef80f3b-f195-42d7-9616-45240468c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:22.261890 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ef80f3b-f195-42d7-9616-45240468c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:22.262774 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ef80f3b-f195-42d7-9616-45240468c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:22.263236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ef80f3b-f195-42d7-9616-45240468c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:22.304984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:22.314741 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9fd7aba9-8126-42ec-b9a3-40a52067659b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.763839 Dec 24 05:02:22.324677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 259/567] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:21 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:22.699327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2ef80f3b-f195-42d7-9616-45240468c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.449168 Dec 24 05:02:22.700667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 309/568] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:22 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:22.704127 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:22.704901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:22.722129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:22.723088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:22.742569 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:22.745343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:22.971010 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:22.972075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:22.985004 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:22.986861 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:22.988058 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:22.988969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:23.114331 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:23.124744 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-36943ccf-c185-4b73-b20f-c07488f025dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1273 microversion: 2.1 time: 0.161027 Dec 24 05:02:23.125741 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 310/569] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:22 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:23.264338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:23.272582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.574231 Dec 24 05:02:23.281649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 260/570] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:22 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:23.334253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:23.340732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:23.353361 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:23.353846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:23.354849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:23.355297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:23.527191 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:23.534435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-26e74bd2-073a-4070-9f01-d89cc93f41d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.207140 Dec 24 05:02:23.544031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 311/571] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:23 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:23.711926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-84d52d85-314f-4521-83d3-0c5d2f73f7a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:23.713794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-84d52d85-314f-4521-83d3-0c5d2f73f7a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:23.722231 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84d52d85-314f-4521-83d3-0c5d2f73f7a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:23.723469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84d52d85-314f-4521-83d3-0c5d2f73f7a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:23.724518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84d52d85-314f-4521-83d3-0c5d2f73f7a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:23.725074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-84d52d85-314f-4521-83d3-0c5d2f73f7a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:23.880256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-84d52d85-314f-4521-83d3-0c5d2f73f7a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.172063 Dec 24 05:02:23.881047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 261/572] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:23 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:24.142078 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:24.142911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:24.150145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.150723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.151781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.152289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.298880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:24.299811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:24.303081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:24.315906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.320090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eb44e2db-4a93-4938-b05f-1359f71396a3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.181928 Dec 24 05:02:24.320848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.321847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.333802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.334072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 312/573] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:24 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:24.347620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-ec360542-3324-487a-a144-d313910399ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:24.350033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:24.350033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:02:24.362550 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-f983d095-022a-4223-a679-96f33a7405df req-ec360542-3324-487a-a144-d313910399ec service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.365015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-f983d095-022a-4223-a679-96f33a7405df req-ec360542-3324-487a-a144-d313910399ec service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.383054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-f983d095-022a-4223-a679-96f33a7405df req-ec360542-3324-487a-a144-d313910399ec service nova] Creating event network-changed:d8920e65-30d8-4362-a099-871fe2010a7c for instance 1ce0890f-150d-48b6-9be0-b572f7429968 on hv-cinder-81644 Dec 24 05:02:24.388142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-f983d095-022a-4223-a679-96f33a7405df req-ec360542-3324-487a-a144-d313910399ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044004 Dec 24 05:02:24.393582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 313/574] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:02:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:02:24.552076 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:24.553053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:24.560862 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.561556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.562507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.563292 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.564997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:24.576269 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-016338e1-f9c8-4951-b18f-a31b223cdd70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.281389 Dec 24 05:02:24.577001 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 262/575] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:24 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:24.697822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:24.705372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-464bee79-6455-4fb3-9110-684456de38d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.157484 Dec 24 05:02:24.705947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 314/576] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:24 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:24.893294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5e1914c4-165a-423e-aa28-6f192dd7b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:24.897540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5e1914c4-165a-423e-aa28-6f192dd7b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:24.904817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e1914c4-165a-423e-aa28-6f192dd7b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.905547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e1914c4-165a-423e-aa28-6f192dd7b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:24.906387 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e1914c4-165a-423e-aa28-6f192dd7b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:24.906895 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e1914c4-165a-423e-aa28-6f192dd7b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:25.068346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5e1914c4-165a-423e-aa28-6f192dd7b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.179296 Dec 24 05:02:25.068997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 263/577] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:24 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:25.338216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:25.339059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:25.345228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:25.345691 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:25.346457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:25.346905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:25.478598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:25.486274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-59caf632-886f-43c9-b4f9-c3716d78f6e5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.151980 Dec 24 05:02:25.486891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 315/578] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:25 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:25.594586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:25.595296 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:25.602425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:25.602867 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:25.603640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:25.604068 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:25.722460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:25.723067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:25.730346 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:25.730837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:25.731608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:25.732036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:25.753172 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:25.762297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.170979 Dec 24 05:02:25.762297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 264/579] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:25 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:25.871189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:25.879674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1599c7be-d8ab-41f0-bd96-d27143b599c5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.160841 Dec 24 05:02:25.880381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 316/580] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:25 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:25.961622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1557699627", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "7d6d1704-2ca9-4ba7-a7ef-cd394e15a741"}]}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:26.018261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] validate_networks() for [('7d6d1704-2ca9-4ba7-a7ef-cd394e15a741', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:02:26.079857 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3e894654-01de-4dfe-89d2-6cbfd41d416d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:26.080851 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3e894654-01de-4dfe-89d2-6cbfd41d416d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:26.088275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e894654-01de-4dfe-89d2-6cbfd41d416d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.088955 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e894654-01de-4dfe-89d2-6cbfd41d416d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.089755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e894654-01de-4dfe-89d2-6cbfd41d416d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.090203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e894654-01de-4dfe-89d2-6cbfd41d416d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.382497 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:02:26.382941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:02:26.383475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:02:26.383878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:02:26.384477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:02:26.385012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3e894654-01de-4dfe-89d2-6cbfd41d416d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.308625 Dec 24 05:02:26.385741 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 317/581] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:26 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:26.398379 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.399031 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.400233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.400930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.418887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Getting quotas for project 122a6a1d32d648c6938f0b159bb3641c. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:02:26.422956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Getting quotas for user 82fc245c775844e6af2acc79a1e637e8 and project 122a6a1d32d648c6938f0b159bb3641c. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:02:26.435412 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:02:26.437947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:02:26.484601 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5146a134-a54b-46df-8722-91b4f403efd6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526869 Dec 24 05:02:26.485249 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 265/582] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:02:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:02:26.496155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75e023d2-f059-4ee7-8871-84598ae870f1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:26.496870 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75e023d2-f059-4ee7-8871-84598ae870f1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:26.503118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:26.503806 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:26.513001 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.513164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.513948 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.514383 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.576472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-75e023d2-f059-4ee7-8871-84598ae870f1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:26.584696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75e023d2-f059-4ee7-8871-84598ae870f1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1219 microversion: 2.1 time: 0.092539 Dec 24 05:02:26.585977 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 318/583] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:26 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:26.682187 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:26.691161 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-01bcc2b4-237c-4f0e-bb79-a819187ca285 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.191641 Dec 24 05:02:26.691869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 266/584] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:26 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:26.780056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:26.780724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:26.787236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.787680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.788456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.788920 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.910196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:26.910996 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:26.917731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.918525 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.919398 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:26.919825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:26.942193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:26.950976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eab05832-63a8-4db9-a1fc-16bc49f2a93f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.176086 Dec 24 05:02:26.951560 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 319/585] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:26 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:27.077241 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:27.084461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cb86d43a-868d-42c9-9342-ab1ef0df751a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.187141 Dec 24 05:02:27.085444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 267/586] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:26 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:27.407358 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c32a1253-b324-431d-8111-b68d2ea0c806 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:27.408825 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c32a1253-b324-431d-8111-b68d2ea0c806 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:27.418022 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c32a1253-b324-431d-8111-b68d2ea0c806 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.418554 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c32a1253-b324-431d-8111-b68d2ea0c806 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:27.419506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c32a1253-b324-431d-8111-b68d2ea0c806 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.419896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c32a1253-b324-431d-8111-b68d2ea0c806 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:27.604470 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:27.605098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:27.610936 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.611372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:27.612141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.612581 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:27.675720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:27.683047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1271 microversion: 2.1 time: 0.082278 Dec 24 05:02:27.683633 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 268/587] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:27 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:27.697167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c32a1253-b324-431d-8111-b68d2ea0c806 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.295071 Dec 24 05:02:27.697773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 320/588] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:27 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:27.708107 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:27.708762 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:27.716649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.717459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:27.718847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.719437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:27.869999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:27.878575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.173206 Dec 24 05:02:27.879308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 269/589] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:27 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:27.969265 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:27.969860 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:27.976922 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.977362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:27.978138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:27.978592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.101145 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:28.101974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:28.110104 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.110821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.112008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.112614 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.142568 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:28.152412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-df69071f-50c6-4c3a-b130-1bc3974fad2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.186203 Dec 24 05:02:28.153098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 321/590] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:27 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:28.373253 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:28.381244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-616b28ed-2e07-47d9-b05b-a9e524859e15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.283627 Dec 24 05:02:28.381913 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 270/591] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:28 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:28.702489 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:28.703080 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:28.710585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cc93cff6-648e-451b-8616-485179982ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:28.710880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.711168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.711921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.712628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.713440 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cc93cff6-648e-451b-8616-485179982ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:28.722817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc93cff6-648e-451b-8616-485179982ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.723381 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc93cff6-648e-451b-8616-485179982ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.724599 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc93cff6-648e-451b-8616-485179982ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.725202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc93cff6-648e-451b-8616-485179982ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.843023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cc93cff6-648e-451b-8616-485179982ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.137591 Dec 24 05:02:28.847154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 271/592] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:28 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:28.860908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:28.869195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ac214975-9b10-49e4-9513-5da54d18785a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.172247 Dec 24 05:02:28.871079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 322/593] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:28 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:28.895806 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:28.896727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:28.904389 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.904890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:28.905755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:28.906218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.170275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:29.171006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:29.178984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.179428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.180203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.180663 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.277235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:29.285264 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6a5a4551-0ef0-414e-9c23-02f1281fa00f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.393554 Dec 24 05:02:29.286042 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 272/594] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:28 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:29.319632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:29.327607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.161645 Dec 24 05:02:29.328175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 323/595] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:29 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:29.400837 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:29.401730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:29.407741 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.408209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.409022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.409452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.633805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:29.642607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-09800d63-7769-4e68-9016-30279a9dd818 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.248032 Dec 24 05:02:29.643183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 273/596] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:29 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:29.856006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8da60022-0a1c-42e0-8a11-b0cd65773cfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:29.857254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8da60022-0a1c-42e0-8a11-b0cd65773cfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:29.866031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8da60022-0a1c-42e0-8a11-b0cd65773cfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.866455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8da60022-0a1c-42e0-8a11-b0cd65773cfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.867276 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8da60022-0a1c-42e0-8a11-b0cd65773cfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.867732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8da60022-0a1c-42e0-8a11-b0cd65773cfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.887990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:29.888664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:29.894826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.895452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.896418 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.896932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:29.963874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8da60022-0a1c-42e0-8a11-b0cd65773cfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.111756 Dec 24 05:02:29.964665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 324/597] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:29 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:29.972058 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-5f1560be-dee1-486d-8978-2fcd8866780b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:29.974024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:29.974024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:02:29.987477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-5f1560be-dee1-486d-8978-2fcd8866780b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:29.988024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-5f1560be-dee1-486d-8978-2fcd8866780b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.001351 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-5f1560be-dee1-486d-8978-2fcd8866780b service nova] Creating event network-changed:f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 for instance e0d6209d-3f4e-4467-bcd3-543f26133bbd on hv-cinder-81644 Dec 24 05:02:30.006402 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-5f1560be-dee1-486d-8978-2fcd8866780b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040259 Dec 24 05:02:30.007425 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 325/598] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:30.082057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:30.090525 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c10b56a4-d72a-4ad4-beed-b7306d65a64b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.206357 Dec 24 05:02:30.091084 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 274/599] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:29 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:30.302217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:30.302906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:30.309525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.309936 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.310925 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.311542 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.344831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:30.345824 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:30.353111 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.353666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.354703 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.355229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.445977 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:30.453531 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f50c741-38c3-44c1-a845-a150e581bdb5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.155692 Dec 24 05:02:30.454429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 326/600] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:30 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:30.520306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:30.529023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c839abad-809b-4344-8bef-dbd7e25283b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.187507 Dec 24 05:02:30.529800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 275/601] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:30 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:30.659266 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:30.659781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:30.666012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.666485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.667541 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.668089 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.804465 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:30.815043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-61084d61-671f-4bfc-938e-0087a19d7a3c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.159397 Dec 24 05:02:30.815692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 327/602] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:30 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:30.868144 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-725ed152-bd73-4c68-a9b0-d9ca0f75da3b req-2125687d-2017-4c7c-ba48-e07a52eb14f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "name": "network-vif-plugged", "status": "completed", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:30.870353 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:30.870353 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:02:30.878785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-725ed152-bd73-4c68-a9b0-d9ca0f75da3b req-2125687d-2017-4c7c-ba48-e07a52eb14f1 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.879662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-725ed152-bd73-4c68-a9b0-d9ca0f75da3b req-2125687d-2017-4c7c-ba48-e07a52eb14f1 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.892993 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-725ed152-bd73-4c68-a9b0-d9ca0f75da3b req-2125687d-2017-4c7c-ba48-e07a52eb14f1 service nova] Creating event network-vif-plugged:7484fcf7-0384-4cf4-8974-7df317686b39 for instance 6e67ec17-823b-4612-8bd4-dbe278717d5e on hv-cinder-81644 Dec 24 05:02:30.897891 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-725ed152-bd73-4c68-a9b0-d9ca0f75da3b req-2125687d-2017-4c7c-ba48-e07a52eb14f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033505 Dec 24 05:02:30.898578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 276/603] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:02:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:30.977665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b1fe2566-fe47-4004-9369-908b325a3810 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:30.979422 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b1fe2566-fe47-4004-9369-908b325a3810 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:30.986623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1fe2566-fe47-4004-9369-908b325a3810 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.987069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1fe2566-fe47-4004-9369-908b325a3810 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:30.987860 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1fe2566-fe47-4004-9369-908b325a3810 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:30.988286 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b1fe2566-fe47-4004-9369-908b325a3810 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.112789 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:31.113710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:31.120190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.120694 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.121507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.121935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.278112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b1fe2566-fe47-4004-9369-908b325a3810 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.306274 Dec 24 05:02:31.278870 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 328/604] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:30 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:31.321012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:31.332877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5ddc2446-0a40-4f4b-8edd-b956ef816967 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.224538 Dec 24 05:02:31.333705 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 277/605] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:31 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:31.474940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:31.476391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:31.488729 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.489579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.490850 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.491772 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.547937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:31.548967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:31.556844 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.557592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.558670 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.559101 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.638171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:31.645661 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.177319 Dec 24 05:02:31.646288 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 329/606] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:31 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:31.692975 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:31.702508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6ccd2981-6455-4890-a529-3629b5eb24f2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.160496 Dec 24 05:02:31.703075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 278/607] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:31 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:31.831626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:31.832786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:31.840932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.841325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.842138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:31.842765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:31.981160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:31.988616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3dbc696e-879e-4672-b91b-2df6db4f2da9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.161126 Dec 24 05:02:31.989161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 330/608] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:31 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:32.290338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a7070959-a7b4-4d28-9670-e0e964f99f2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:32.291257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a7070959-a7b4-4d28-9670-e0e964f99f2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:32.298048 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7070959-a7b4-4d28-9670-e0e964f99f2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.298488 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7070959-a7b4-4d28-9670-e0e964f99f2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.299265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7070959-a7b4-4d28-9670-e0e964f99f2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.299689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a7070959-a7b4-4d28-9670-e0e964f99f2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.351142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:32.351755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:32.358726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.359170 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.359940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.360370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.476868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a7070959-a7b4-4d28-9670-e0e964f99f2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.190048 Dec 24 05:02:32.477677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 279/609] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:32 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:32.497320 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:32.505833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5659caf9-ea22-4d6a-bf14-2439a0a75148 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.158237 Dec 24 05:02:32.506485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 331/610] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:32 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:32.667537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:32.668415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:32.675588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.676031 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.676833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.677261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.723077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:32.724067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:32.732564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.733033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.733816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:32.734245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:32.826760 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:32.834358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c3328b22-3699-425e-85a0-43f6bea353ca tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.173600 Dec 24 05:02:32.835227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 280/611] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:32 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:32.869587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:32.878155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.161017 Dec 24 05:02:32.878728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 332/612] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:32 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:33.009289 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:33.010276 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:33.020868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.021624 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.022973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.023568 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.167890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:33.175481 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1317 microversion: 2.1 time: 0.172210 Dec 24 05:02:33.176046 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 281/613] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:33 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:33.492790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ca8eea94-007f-4b4b-9832-4e0f04e5d6d3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:33.494230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ca8eea94-007f-4b4b-9832-4e0f04e5d6d3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:33.509830 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca8eea94-007f-4b4b-9832-4e0f04e5d6d3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.510682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca8eea94-007f-4b4b-9832-4e0f04e5d6d3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.512175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca8eea94-007f-4b4b-9832-4e0f04e5d6d3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.512636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca8eea94-007f-4b4b-9832-4e0f04e5d6d3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.522506 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:33.523141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:33.529933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.530374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.531141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.531683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.680755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:33.690294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-51f58c48-aa7d-4511-b5d9-b39026d7b61e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.171215 Dec 24 05:02:33.691190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 282/614] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:33 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:33.793894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ca8eea94-007f-4b4b-9832-4e0f04e5d6d3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.306375 Dec 24 05:02:33.794760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 333/615] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:33 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:33.852221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:33.852858 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:33.858951 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.859392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.860153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.860609 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.898121 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:33.898710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:33.906565 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.907012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.907798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:33.908254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:33.998073 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:34.005339 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-780fc54d-55b2-4f22-93ba-0662e345598d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.157375 Dec 24 05:02:34.005935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 283/616] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:33 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:34.045194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:34.053242 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1d3079b3-4de7-4099-b00c-b4d1b144e32f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.159252 Dec 24 05:02:34.053806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 334/617] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:33 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:34.192886 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:34.193766 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:34.207174 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:34.207609 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:34.208384 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:34.209131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:34.356814 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:34.364659 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-be912895-2ac9-4c6c-8f45-51ac69c73c51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1507 microversion: 2.1 time: 0.175881 Dec 24 05:02:34.365245 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 284/618] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:34 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:34.711074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:34.711707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:34.718558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:34.718994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:34.719784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:34.720188 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:34.730360 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-1960fe04-19f6-4def-9dbb-6b25646c46d7 req-39e74666-d185-4a22-b313-3dbd73a9681d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "name": "network-vif-plugged", "status": "completed", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:34.732106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:34.732106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:02:34.739765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-1960fe04-19f6-4def-9dbb-6b25646c46d7 req-39e74666-d185-4a22-b313-3dbd73a9681d service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:34.740217 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-1960fe04-19f6-4def-9dbb-6b25646c46d7 req-39e74666-d185-4a22-b313-3dbd73a9681d service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:34.751892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-1960fe04-19f6-4def-9dbb-6b25646c46d7 req-39e74666-d185-4a22-b313-3dbd73a9681d service nova] Creating event network-vif-plugged:d8920e65-30d8-4362-a099-871fe2010a7c for instance 1ce0890f-150d-48b6-9be0-b572f7429968 on hv-cinder-81644 Dec 24 05:02:34.756810 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-1960fe04-19f6-4def-9dbb-6b25646c46d7 req-39e74666-d185-4a22-b313-3dbd73a9681d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030062 Dec 24 05:02:34.757394 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 285/619] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:02:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:02:34.807265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1d31a5cd-0e33-4e17-81bc-977435125c8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:34.808332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1d31a5cd-0e33-4e17-81bc-977435125c8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:34.815010 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d31a5cd-0e33-4e17-81bc-977435125c8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:34.815480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d31a5cd-0e33-4e17-81bc-977435125c8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:34.816251 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d31a5cd-0e33-4e17-81bc-977435125c8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:34.816713 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1d31a5cd-0e33-4e17-81bc-977435125c8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:34.869812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:34.878183 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-277a98a7-db7c-4f05-8fde-ad10db166835 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.171772 Dec 24 05:02:34.878799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 335/620] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:34 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:34.956035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1d31a5cd-0e33-4e17-81bc-977435125c8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.152988 Dec 24 05:02:34.956720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 286/621] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:34 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:35.022715 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:35.023216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:35.029166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.029598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:35.030369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.030754 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:35.070543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:35.071304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:35.078256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.078703 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:35.079471 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.079896 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:35.165817 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:35.173341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-34d321ad-6251-4994-b172-d2987137a6c3 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.154891 Dec 24 05:02:35.173990 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 336/622] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:35 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:35.214666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:35.224158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-64601cc6-3576-4103-a751-30cb47cc0dd9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.157578 Dec 24 05:02:35.224739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 287/623] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:35 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:35.896655 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:35.897349 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:35.904641 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.905009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:35.905776 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.906203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:35.967594 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c09b5bc7-dfe8-4ab2-a25a-d6295ccb7612 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:35.968557 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c09b5bc7-dfe8-4ab2-a25a-d6295ccb7612 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:35.974907 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09b5bc7-dfe8-4ab2-a25a-d6295ccb7612 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.975353 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09b5bc7-dfe8-4ab2-a25a-d6295ccb7612 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:35.976127 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09b5bc7-dfe8-4ab2-a25a-d6295ccb7612 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:35.976562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c09b5bc7-dfe8-4ab2-a25a-d6295ccb7612 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:36.044478 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:36.051997 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.159696 Dec 24 05:02:36.052590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 337/624] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:35 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:36.091083 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c09b5bc7-dfe8-4ab2-a25a-d6295ccb7612 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.127236 Dec 24 05:02:36.091723 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 288/625] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:35 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:36.189667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:36.190197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:36.196506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:36.196973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:36.198255 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:36.198918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:36.241405 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:36.242096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:36.250406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:36.250847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:36.251635 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:36.252081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:36.342732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:36.350666 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-95ad670f-a672-4991-b9f6-97b9b9c73f92 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.164656 Dec 24 05:02:36.351237 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 338/626] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:36 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:36.396932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:36.405673 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-95546d1e-af4c-4059-9c45-8226e0d082d9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.168310 Dec 24 05:02:36.406229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 289/627] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:36 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:36.747724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aac91bdb-f246-4a69-87a0-d22b657031ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d385c08-edbd-44ec-b118-99ac8454f462"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:36.748918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-aac91bdb-f246-4a69-87a0-d22b657031ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:36.755227 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aac91bdb-f246-4a69-87a0-d22b657031ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:36.755728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aac91bdb-f246-4a69-87a0-d22b657031ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:36.756667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aac91bdb-f246-4a69-87a0-d22b657031ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:36.757062 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aac91bdb-f246-4a69-87a0-d22b657031ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.062309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aac91bdb-f246-4a69-87a0-d22b657031ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "POST /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319115 Dec 24 05:02:37.063055 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 339/628] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:02:36 2021] POST /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:37.068412 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:37.069057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:37.076091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.076807 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.077793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.078391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.103521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f8419d1f-118b-4e47-9a89-4ac816e7678c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:37.104812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f8419d1f-118b-4e47-9a89-4ac816e7678c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:37.111037 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8419d1f-118b-4e47-9a89-4ac816e7678c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.111479 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8419d1f-118b-4e47-9a89-4ac816e7678c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.112248 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8419d1f-118b-4e47-9a89-4ac816e7678c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.112698 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f8419d1f-118b-4e47-9a89-4ac816e7678c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.218367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:37.226166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e5f67aa9-4360-4f8d-8869-5864b7578976 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.161412 Dec 24 05:02:37.226704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 290/629] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:37 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:37.237454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f8419d1f-118b-4e47-9a89-4ac816e7678c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.137658 Dec 24 05:02:37.238209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 340/630] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:37 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:37.370488 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:37.371092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:37.377541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.377989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.378760 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.379191 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.424763 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:37.425449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:37.433061 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.433611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.434398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:37.434830 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:37.520192 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:37.527915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1315 microversion: 2.1 time: 0.163458 Dec 24 05:02:37.528718 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 291/631] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:37 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:37.550683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:02:37.551132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:02:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:02:37.578144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:37.586437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c450241d-c1c8-43b7-b8b6-a0087a3c132c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.165648 Dec 24 05:02:37.586943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 341/632] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:37 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:38.246242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:38.246830 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:38.250184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9ddcf6a3-d881-4a17-8d94-671591a4032d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:38.251382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9ddcf6a3-d881-4a17-8d94-671591a4032d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:38.253764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.254237 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.255007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.255465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.257912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ddcf6a3-d881-4a17-8d94-671591a4032d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.258352 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ddcf6a3-d881-4a17-8d94-671591a4032d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.259113 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ddcf6a3-d881-4a17-8d94-671591a4032d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.259544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ddcf6a3-d881-4a17-8d94-671591a4032d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.363757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9ddcf6a3-d881-4a17-8d94-671591a4032d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.117031 Dec 24 05:02:38.367889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 342/633] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:38 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:38.401094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:38.409230 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8295c55c-0ec4-48fc-aa9d-988700a7b69a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.168401 Dec 24 05:02:38.409704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 292/634] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:38 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:38.549553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:38.550692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:38.562797 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.563585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.564927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.565637 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.603895 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:38.604861 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:38.611451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.611966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.612852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.613586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.706697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:38.714809 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1465 microversion: 2.1 time: 0.172246 Dec 24 05:02:38.715378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 343/635] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:38 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1465 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:38.743650 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:38.752406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c79ee909-e798-4438-aa53-f94e7ee49ff7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.152325 Dec 24 05:02:38.753008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 293/636] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:38 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:38.753619 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:38.754114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:38.760028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.761219 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.762015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.762442 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.788004 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:02:38.866588 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 204 len: 0 microversion: 2.1 time: 0.116334 Dec 24 05:02:38.867586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 344/637] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:02:38 2021] DELETE /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:02:38.876169 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:38.876943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:38.883403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.883847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:38.884639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:38.885063 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:39.034877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:39.045740 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-20b36640-bb09-447b-84d2-630511513f9d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1471 microversion: 2.1 time: 0.172957 Dec 24 05:02:39.046442 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 294/638] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:38 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:39.376570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bfef38a5-d628-4839-9c62-6cc8d371d016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:39.377658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bfef38a5-d628-4839-9c62-6cc8d371d016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:39.384240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfef38a5-d628-4839-9c62-6cc8d371d016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:39.384787 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfef38a5-d628-4839-9c62-6cc8d371d016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:39.385569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfef38a5-d628-4839-9c62-6cc8d371d016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:39.386011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfef38a5-d628-4839-9c62-6cc8d371d016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:39.428494 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:39.429160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:39.439205 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:39.439911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:39.441244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:39.441952 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:39.593274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:39.601136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-61f35de2-b712-473c-90f2-befdb385484a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.178471 Dec 24 05:02:39.601714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 295/639] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:39 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:39.650632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bfef38a5-d628-4839-9c62-6cc8d371d016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.277990 Dec 24 05:02:39.651413 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 345/640] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:39 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:39.769615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:39.770245 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:39.776696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:39.777164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:39.777932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:39.778358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:39.923403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:39.931812 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-118fe3dd-b39e-429d-99e7-b720e2781ad1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.165936 Dec 24 05:02:39.932572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 296/641] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:39 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:40.067874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:40.069035 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:40.077650 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.078083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.078845 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.079264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.226704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:40.234531 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1471 microversion: 2.1 time: 0.173157 Dec 24 05:02:40.235085 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 346/642] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:40 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:40.617935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:40.618576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:40.625628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.626066 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.627036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.627531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.664095 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b6f9cd46-206b-4cf1-a75c-99a99cbcf477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:40.665893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b6f9cd46-206b-4cf1-a75c-99a99cbcf477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:40.679660 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6f9cd46-206b-4cf1-a75c-99a99cbcf477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.680357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6f9cd46-206b-4cf1-a75c-99a99cbcf477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.681359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6f9cd46-206b-4cf1-a75c-99a99cbcf477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.682049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6f9cd46-206b-4cf1-a75c-99a99cbcf477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.773710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:40.781423 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.167180 Dec 24 05:02:40.781987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 297/643] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:40 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:40.786419 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-b18bbedc-3eb0-46a8-af7f-50d1d6aa0758 req-92285e74-b2b1-4d9a-8e62-03c0a71db58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "name": "network-vif-plugged", "status": "completed", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:40.787889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:40.787889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:02:40.795598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-b18bbedc-3eb0-46a8-af7f-50d1d6aa0758 req-92285e74-b2b1-4d9a-8e62-03c0a71db58a service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.796037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-b18bbedc-3eb0-46a8-af7f-50d1d6aa0758 req-92285e74-b2b1-4d9a-8e62-03c0a71db58a service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.807044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-b18bbedc-3eb0-46a8-af7f-50d1d6aa0758 req-92285e74-b2b1-4d9a-8e62-03c0a71db58a service nova] Creating event network-vif-plugged:f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 for instance e0d6209d-3f4e-4467-bcd3-543f26133bbd on hv-cinder-81644 Dec 24 05:02:40.813224 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-b18bbedc-3eb0-46a8-af7f-50d1d6aa0758 req-92285e74-b2b1-4d9a-8e62-03c0a71db58a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030136 Dec 24 05:02:40.813845 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 298/644] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:02:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:40.929662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b6f9cd46-206b-4cf1-a75c-99a99cbcf477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.269990 Dec 24 05:02:40.936284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 347/645] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:40 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:40.949793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:40.950513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:40.956912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.957400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:40.958154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:40.958547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.251895 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:41.252615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:41.261298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:41.266317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:41.266760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.267540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:41.267963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.275349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7290799a-37a4-4554-b280-ad0fea576aa1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.329880 Dec 24 05:02:41.286853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 299/646] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:40 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:41.415081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:41.422437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1471 microversion: 2.1 time: 0.174573 Dec 24 05:02:41.423021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 348/647] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:41 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:41.556091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-53b99c99-f985-4344-81af-7386fc11b32b req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "name": "network-vif-deleted", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:41.557854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:41.557854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:02:41.564835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-53b99c99-f985-4344-81af-7386fc11b32b req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:41.565274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-53b99c99-f985-4344-81af-7386fc11b32b req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.580914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-53b99c99-f985-4344-81af-7386fc11b32b req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 service nova] Creating event network-vif-deleted:d8920e65-30d8-4362-a099-871fe2010a7c for instance 1ce0890f-150d-48b6-9be0-b572f7429968 on hv-cinder-81644 Dec 24 05:02:41.586311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-53b99c99-f985-4344-81af-7386fc11b32b req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Dec 24 05:02:41.587097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 300/648] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:02:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:02:41.801691 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:41.802594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:41.811371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:41.812015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.813033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:41.813589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.948510 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1c365a14-5397-48fe-a650-d89559f3d9b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:41.954919 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1c365a14-5397-48fe-a650-d89559f3d9b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:41.957784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:41.962075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c365a14-5397-48fe-a650-d89559f3d9b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:41.962517 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c365a14-5397-48fe-a650-d89559f3d9b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.963298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c365a14-5397-48fe-a650-d89559f3d9b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:41.963789 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c365a14-5397-48fe-a650-d89559f3d9b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:41.965597 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-af8007f7-10ef-43dd-8fa0-72144514bd93 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.169907 Dec 24 05:02:41.966194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 349/649] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:41 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:42.061664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1c365a14-5397-48fe-a650-d89559f3d9b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.118016 Dec 24 05:02:42.062309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 301/650] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:41 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:42.298733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:42.299769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:42.310992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:42.311624 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:42.313094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:42.313796 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:42.439766 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:42.440448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:42.447240 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:42.447673 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:42.448958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:42.449270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:42.474228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:42.482520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3ded99cf-8275-4f15-932c-6e4b4472fc28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.190458 Dec 24 05:02:42.483084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 350/651] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:42 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:42.483880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:42.484320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:42.484785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lazy-loading 'fault' on Instance uuid 1ce0890f-150d-48b6-9be0-b572f7429968 {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:02:42.526003 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a777bab1007446e3bdcf9332119a2c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad82f86c5b5403799701feca92f316e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:42.534025 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ef075eec-8439-427a-abcb-203843b68fe0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 200 len: 1305 microversion: 2.1 time: 0.098552 Dec 24 05:02:42.534584 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 302/652] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:42 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:42.984547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:42.985161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:42.991733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:42.992175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:42.992983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:42.993371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:43.075062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-658019ab-1c3d-4324-813d-211e661de4cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:43.077387 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-658019ab-1c3d-4324-813d-211e661de4cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:43.085629 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-658019ab-1c3d-4324-813d-211e661de4cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:43.086105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-658019ab-1c3d-4324-813d-211e661de4cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:43.086921 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-658019ab-1c3d-4324-813d-211e661de4cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:43.087654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-658019ab-1c3d-4324-813d-211e661de4cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:43.132810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:43.140427 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2406beda-1822-4967-9adc-cb91ad52ace8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1319 microversion: 2.1 time: 0.160060 Dec 24 05:02:43.141018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 351/653] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:42 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:43.249817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-658019ab-1c3d-4324-813d-211e661de4cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.178415 Dec 24 05:02:43.250629 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 303/654] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:43 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:43.499161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:43.499684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:43.506415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:43.506840 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:43.507620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:43.508046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:43.552972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:43.553683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] [instance: 1ce0890f-150d-48b6-9be0-b572f7429968] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:43.561153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:43.561599 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:43.562375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:43.562802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:43.577158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] HTTP exception thrown: Instance 1ce0890f-150d-48b6-9be0-b572f7429968 could not be found. Dec 24 05:02:43.577727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Returning 404 to user: Instance 1ce0890f-150d-48b6-9be0-b572f7429968 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:02:43.578549 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ede1e211-de74-4e43-833f-caee8c6fcf7a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968" status: 404 len: 111 microversion: 2.1 time: 0.029662 Dec 24 05:02:43.579074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 304/655] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:43 2021] GET /compute/v2.1/servers/1ce0890f-150d-48b6-9be0-b572f7429968 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:02:43.648941 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:43.657718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a7366b95-3c34-47ab-801f-1ef163e451fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.162199 Dec 24 05:02:43.658315 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 352/656] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:43 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:44.156824 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:44.157492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:44.163881 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:44.164298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:44.165273 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:44.165691 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:44.262612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7bad4668-fb51-4dda-a364-4bc892f20438 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:44.263714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7bad4668-fb51-4dda-a364-4bc892f20438 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:44.270278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7bad4668-fb51-4dda-a364-4bc892f20438 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:44.270714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7bad4668-fb51-4dda-a364-4bc892f20438 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:44.271597 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7bad4668-fb51-4dda-a364-4bc892f20438 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:44.272016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7bad4668-fb51-4dda-a364-4bc892f20438 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:44.305958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:44.313742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1508 microversion: 2.1 time: 0.160411 Dec 24 05:02:44.314492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 305/657] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:44 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:44.373017 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7bad4668-fb51-4dda-a364-4bc892f20438 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.112036 Dec 24 05:02:44.373017 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 353/658] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:44 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:44.675451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:44.676127 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:44.683802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:44.684494 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:44.685400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:44.685870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:44.861749 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:44.869893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.198382 Dec 24 05:02:44.870415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 306/659] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:44 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:45.383635 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a9287a25-a261-4285-9328-7fbd334b3e20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:45.384665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a9287a25-a261-4285-9328-7fbd334b3e20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:45.391756 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9287a25-a261-4285-9328-7fbd334b3e20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:45.392200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9287a25-a261-4285-9328-7fbd334b3e20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:45.393027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9287a25-a261-4285-9328-7fbd334b3e20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:45.393438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a9287a25-a261-4285-9328-7fbd334b3e20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:45.534844 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a9287a25-a261-4285-9328-7fbd334b3e20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.155008 Dec 24 05:02:45.535858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 354/660] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:45 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:45.887207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:45.887830 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:45.894421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:45.894838 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:45.895618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:45.896053 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:46.037598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:46.046253 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-55bd6060-43ef-4e0e-a023-fb335a826cf4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.163177 Dec 24 05:02:46.046826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 307/661] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:45 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:46.547840 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4ecff9f2-6066-4867-9aee-e61b1406227d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:46.548880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4ecff9f2-6066-4867-9aee-e61b1406227d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:46.555959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecff9f2-6066-4867-9aee-e61b1406227d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:46.556403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecff9f2-6066-4867-9aee-e61b1406227d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:46.557209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecff9f2-6066-4867-9aee-e61b1406227d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:46.557976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ecff9f2-6066-4867-9aee-e61b1406227d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:46.675777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4ecff9f2-6066-4867-9aee-e61b1406227d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.131896 Dec 24 05:02:46.676343 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 355/662] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:46 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:47.064079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:47.065372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:47.072199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:47.072673 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:47.073677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:47.073999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:47.227016 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:47.238803 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ecde2813-17a1-4aa3-a902-0b6e288322da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.178577 Dec 24 05:02:47.239577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 308/663] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:47 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:47.688649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d478d9db-f11e-4c85-a0fc-8a7c53027863 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:47.689559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d478d9db-f11e-4c85-a0fc-8a7c53027863 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:47.696804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d478d9db-f11e-4c85-a0fc-8a7c53027863 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:47.697252 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d478d9db-f11e-4c85-a0fc-8a7c53027863 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:47.698159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d478d9db-f11e-4c85-a0fc-8a7c53027863 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:47.699003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d478d9db-f11e-4c85-a0fc-8a7c53027863 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:47.853828 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d478d9db-f11e-4c85-a0fc-8a7c53027863 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.169301 Dec 24 05:02:47.854521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 356/664] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:47 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:48.261367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:48.262251 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:48.270311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:48.270759 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:48.271536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:48.271989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:48.424516 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:48.433893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1566 microversion: 2.1 time: 0.178689 Dec 24 05:02:48.434645 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 309/665] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:48 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:48.868128 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8bba5280-21d1-4578-9812-8f14eb7c714a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:48.870446 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8bba5280-21d1-4578-9812-8f14eb7c714a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:48.878667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bba5280-21d1-4578-9812-8f14eb7c714a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:48.879187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bba5280-21d1-4578-9812-8f14eb7c714a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:48.880209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bba5280-21d1-4578-9812-8f14eb7c714a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:48.880588 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8bba5280-21d1-4578-9812-8f14eb7c714a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:48.995033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8bba5280-21d1-4578-9812-8f14eb7c714a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.131805 Dec 24 05:02:48.996873 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 357/666] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:48 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:49.453457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:49.454045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:49.462473 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.462923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:49.463758 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.464211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:49.598413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:49.606793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-826646a2-f251-4f68-8e13-c788c9f08bfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1546 microversion: 2.1 time: 0.157191 Dec 24 05:02:49.607371 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 310/667] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:49 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:49.625943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:49.626540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:49.633765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.634199 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:49.634984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.635495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:49.774589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] HTTP exception thrown: Cannot 'detach_volume' instance 27408900-d9e8-47e1-be4d-aac80e3f6fae while it is in vm_state rescued Dec 24 05:02:49.775323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Returning 409 to user: Cannot 'detach_volume' instance 27408900-d9e8-47e1-be4d-aac80e3f6fae while it is in vm_state rescued {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:02:49.776648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f4c3cf6-3b41-4706-baf9-c5094d7ed87b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments/931dfc1a-ccc6-4d07-80e6-33faba1e3135" status: 409 len: 152 microversion: 2.1 time: 0.156920 Dec 24 05:02:49.777392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 358/668] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:02:49 2021] DELETE /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments/931dfc1a-ccc6-4d07-80e6-33faba1e3135 => generated 152 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 24 05:02:49.789996 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e09b54f3-eea3-440b-8c64-ad3ee0094408 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:49.790761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e09b54f3-eea3-440b-8c64-ad3ee0094408 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:49.797650 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e09b54f3-eea3-440b-8c64-ad3ee0094408 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.798085 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e09b54f3-eea3-440b-8c64-ad3ee0094408 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:49.798845 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e09b54f3-eea3-440b-8c64-ad3ee0094408 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.799271 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e09b54f3-eea3-440b-8c64-ad3ee0094408 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:49.870491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e09b54f3-eea3-440b-8c64-ad3ee0094408 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action" status: 202 len: 0 microversion: 2.1 time: 0.086382 Dec 24 05:02:49.871111 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 311/669] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:02:49 2021] POST /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:49.881945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:49.882512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:49.890452 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.891042 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:49.892117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:49.892653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:50.008169 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-67338400-835a-4a61-9f4e-07af9e039a76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:50.009212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-67338400-835a-4a61-9f4e-07af9e039a76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:50.015746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67338400-835a-4a61-9f4e-07af9e039a76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:50.016188 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67338400-835a-4a61-9f4e-07af9e039a76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:50.016962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67338400-835a-4a61-9f4e-07af9e039a76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:50.017415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67338400-835a-4a61-9f4e-07af9e039a76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:50.029761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:50.039146 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.162542 Dec 24 05:02:50.040385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 359/670] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:49 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:50.134444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-67338400-835a-4a61-9f4e-07af9e039a76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.130055 Dec 24 05:02:50.135090 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 312/671] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:50 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:02:51.059272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:51.059945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:51.066608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:51.067058 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:51.067829 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:51.068255 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:51.146953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-417a5443-80c1-4588-add6-d13172ae3c4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:51.147933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-417a5443-80c1-4588-add6-d13172ae3c4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:51.155079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-417a5443-80c1-4588-add6-d13172ae3c4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:51.155518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-417a5443-80c1-4588-add6-d13172ae3c4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:51.156336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-417a5443-80c1-4588-add6-d13172ae3c4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:51.156783 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-417a5443-80c1-4588-add6-d13172ae3c4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:51.209520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:51.218703 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-58f36259-5489-4380-b9d6-8bfa3532f35f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.164385 Dec 24 05:02:51.219281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 360/672] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:51 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:51.292180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-417a5443-80c1-4588-add6-d13172ae3c4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.148406 Dec 24 05:02:51.292956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 313/673] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:51 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:52.239101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:52.240082 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:52.250579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:52.251312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:52.252581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:52.253325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:52.303900 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-23edbec2-6dfb-496f-8aff-7d795f9649ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:52.305029 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-23edbec2-6dfb-496f-8aff-7d795f9649ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:52.317125 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-23edbec2-6dfb-496f-8aff-7d795f9649ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:52.317559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-23edbec2-6dfb-496f-8aff-7d795f9649ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:52.318313 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-23edbec2-6dfb-496f-8aff-7d795f9649ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:52.319194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-23edbec2-6dfb-496f-8aff-7d795f9649ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:52.390673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:52.399168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-761dcba4-f986-4f88-99ec-980f838368eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.166204 Dec 24 05:02:52.399869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 361/674] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:52 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:52.513888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-23edbec2-6dfb-496f-8aff-7d795f9649ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.213175 Dec 24 05:02:52.514883 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 314/675] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:52 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:02:53.419006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:53.419620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:53.428235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:53.428962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:53.430317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:53.430801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:53.528791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5c91c6f4-961f-4d82-953e-358a54461209 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:02:53.529896 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5c91c6f4-961f-4d82-953e-358a54461209 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:53.537310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c91c6f4-961f-4d82-953e-358a54461209 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:53.537836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c91c6f4-961f-4d82-953e-358a54461209 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:53.538694 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c91c6f4-961f-4d82-953e-358a54461209 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:53.539185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c91c6f4-961f-4d82-953e-358a54461209 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:53.579817 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:53.588484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f233c815-47eb-4864-b565-7e8a3066c4f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.173629 Dec 24 05:02:53.589215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 362/676] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:53 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:54.607071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:54.607889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:54.615623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:54.616105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:54.617046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:54.617547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:54.758724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:54.766636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-826739e9-ffc5-444d-8093-77899824223c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.163870 Dec 24 05:02:54.767200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 363/677] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:54 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:55.786991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:55.788179 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:55.796195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:55.796643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:55.797470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:55.798171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:55.930561 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:55.939159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.158171 Dec 24 05:02:55.939716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 364/678] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:55 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:56.956887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:56.957609 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:56.964439 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:56.964911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:56.965831 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:56.966256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:57.109074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:57.117470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-11453b13-7c78-4674-8782-a2861a77488e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.164566 Dec 24 05:02:57.118003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 365/679] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:56 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:02:58.135017 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:58.135778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:58.142495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:58.142943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:58.143704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:58.144131 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:58.280611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:58.292684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-66cf334d-8c35-450b-83f3-eade047aa8be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.161179 Dec 24 05:02:58.293412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 366/680] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:58 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:02:59.312451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:02:59.313139 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:02:59.319793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:59.320231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:59.321030 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:02:59.321451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:02:59.457616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:02:59.468600 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-12737fe6-458d-4e76-b77d-9cf18fb81f67 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.159584 Dec 24 05:02:59.469381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 367/681] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:02:59 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:00.490874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:00.491459 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:00.498153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:00.498596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:00.499425 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:00.499791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:00.633234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:00.641258 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-02682518-9453-4a2f-ba6c-8cec770a9b6f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.153955 Dec 24 05:03:00.641788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 368/682] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:00 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:01.316598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5c91c6f4-961f-4d82-953e-358a54461209 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 7.787785 Dec 24 05:03:01.316598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 315/683] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:02:53 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 7790 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:01.661071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:01.661760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:01.669931 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:01.670379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:01.671176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:01.671608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:01.806234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:01.817287 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e881453b-9649-401b-8b6d-6fc3fcafeb82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1554 microversion: 2.1 time: 0.161253 Dec 24 05:03:01.818051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 369/684] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:01 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:02.324515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6626cd96-3001-4378-9d19-368d24a7616f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:02.329050 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6626cd96-3001-4378-9d19-368d24a7616f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:02.342768 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6626cd96-3001-4378-9d19-368d24a7616f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:02.343211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6626cd96-3001-4378-9d19-368d24a7616f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:02.344009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6626cd96-3001-4378-9d19-368d24a7616f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:02.344590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6626cd96-3001-4378-9d19-368d24a7616f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:02.606156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6626cd96-3001-4378-9d19-368d24a7616f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.285831 Dec 24 05:03:02.607820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 316/685] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:02 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:02.835585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:02.836387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:02.843638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:02.844115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:02.844999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:02.845513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.001882 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:03.013409 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4274ec78-a631-486f-b44e-48eb0813dc66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1560 microversion: 2.1 time: 0.181661 Dec 24 05:03:03.014149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 370/686] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:02 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:03.092259 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:03.092867 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:03.099920 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.100300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.101106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.101533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.177363 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lazy-loading 'services' on Instance uuid 27408900-d9e8-47e1-be4d-aac80e3f6fae {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:03.265615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1b584926-da6e-4206-ade5-87167e10631f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments/931dfc1a-ccc6-4d07-80e6-33faba1e3135" status: 202 len: 0 microversion: 2.1 time: 0.177456 Dec 24 05:03:03.266156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 317/687] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:03:03 2021] DELETE /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments/931dfc1a-ccc6-4d07-80e6-33faba1e3135 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:03.274323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4b97934a-7c4b-4361-b9ea-6edc11c8f86d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:03.275633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4b97934a-7c4b-4361-b9ea-6edc11c8f86d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:03.282001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b97934a-7c4b-4361-b9ea-6edc11c8f86d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.282766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b97934a-7c4b-4361-b9ea-6edc11c8f86d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.283656 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b97934a-7c4b-4361-b9ea-6edc11c8f86d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.284208 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b97934a-7c4b-4361-b9ea-6edc11c8f86d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.317663 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4b97934a-7c4b-4361-b9ea-6edc11c8f86d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Dec 24 05:03:03.318205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 371/688] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:03 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:03.620873 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8f422f1c-ada8-4741-be59-cdaad06ba9cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:03.622492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8f422f1c-ada8-4741-be59-cdaad06ba9cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:03.629324 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f422f1c-ada8-4741-be59-cdaad06ba9cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.629760 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f422f1c-ada8-4741-be59-cdaad06ba9cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.630571 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f422f1c-ada8-4741-be59-cdaad06ba9cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.631071 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f422f1c-ada8-4741-be59-cdaad06ba9cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.784756 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8f422f1c-ada8-4741-be59-cdaad06ba9cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.169200 Dec 24 05:03:03.785491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 318/689] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:03 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:03.825369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:03.825866 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:03.832303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.832776 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.833581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:03.834009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:03.922324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'services' on Instance uuid 6e67ec17-823b-4612-8bd4-dbe278717d5e {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:04.041395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8f9c4065-c5e9-4899-969d-f845c2a42fd8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments/1d385c08-edbd-44ec-b118-99ac8454f462" status: 202 len: 0 microversion: 2.1 time: 0.219566 Dec 24 05:03:04.042255 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 372/690] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:03:03 2021] DELETE /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments/1d385c08-edbd-44ec-b118-99ac8454f462 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:04.052368 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d8b56520-93e6-4b89-8968-5b4b86d57a37 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:04.053396 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d8b56520-93e6-4b89-8968-5b4b86d57a37 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:04.060921 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8b56520-93e6-4b89-8968-5b4b86d57a37 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:04.061365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8b56520-93e6-4b89-8968-5b4b86d57a37 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:04.062185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8b56520-93e6-4b89-8968-5b4b86d57a37 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:04.062692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8b56520-93e6-4b89-8968-5b4b86d57a37 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:04.100924 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d8b56520-93e6-4b89-8968-5b4b86d57a37 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052553 Dec 24 05:03:04.101469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 319/691] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:04 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:04.332583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f334f5a9-02ad-41c8-a1bc-d668f42715f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:04.334088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f334f5a9-02ad-41c8-a1bc-d668f42715f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:04.342788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f334f5a9-02ad-41c8-a1bc-d668f42715f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:04.343225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f334f5a9-02ad-41c8-a1bc-d668f42715f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:04.343995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f334f5a9-02ad-41c8-a1bc-d668f42715f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:04.344424 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f334f5a9-02ad-41c8-a1bc-d668f42715f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:04.374786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f334f5a9-02ad-41c8-a1bc-d668f42715f5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048062 Dec 24 05:03:04.375330 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 373/692] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:04 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:04.796438 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4a7d9f2e-c98d-4bef-b553-b0036b5e1474 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:04.797405 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4a7d9f2e-c98d-4bef-b553-b0036b5e1474 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:04.804229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a7d9f2e-c98d-4bef-b553-b0036b5e1474 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:04.804707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a7d9f2e-c98d-4bef-b553-b0036b5e1474 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:04.805477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a7d9f2e-c98d-4bef-b553-b0036b5e1474 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:04.805902 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a7d9f2e-c98d-4bef-b553-b0036b5e1474 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:04.912042 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4a7d9f2e-c98d-4bef-b553-b0036b5e1474 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.118855 Dec 24 05:03:04.912853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 320/693] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:04 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:05.115392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-472af4a0-3eda-4dee-a0a0-324e81334401 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:05.116777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-472af4a0-3eda-4dee-a0a0-324e81334401 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:05.125017 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-472af4a0-3eda-4dee-a0a0-324e81334401 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:05.125455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-472af4a0-3eda-4dee-a0a0-324e81334401 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:05.126213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-472af4a0-3eda-4dee-a0a0-324e81334401 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:05.126638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-472af4a0-3eda-4dee-a0a0-324e81334401 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:05.155780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-472af4a0-3eda-4dee-a0a0-324e81334401 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Dec 24 05:03:05.156322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 374/694] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:05 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:05.389927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-88dd4562-375f-48ac-9b02-fadd8192f9b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:05.390837 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-88dd4562-375f-48ac-9b02-fadd8192f9b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:05.398074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88dd4562-375f-48ac-9b02-fadd8192f9b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:05.398487 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88dd4562-375f-48ac-9b02-fadd8192f9b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:05.399267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88dd4562-375f-48ac-9b02-fadd8192f9b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:05.399690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88dd4562-375f-48ac-9b02-fadd8192f9b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:05.429747 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-88dd4562-375f-48ac-9b02-fadd8192f9b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Dec 24 05:03:05.430278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 321/695] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:05 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:05.928574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8832518b-2d5c-4b26-840c-49913d89ad0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:05.929820 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8832518b-2d5c-4b26-840c-49913d89ad0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:05.938796 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8832518b-2d5c-4b26-840c-49913d89ad0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:05.939370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8832518b-2d5c-4b26-840c-49913d89ad0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:05.940517 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8832518b-2d5c-4b26-840c-49913d89ad0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:05.941011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8832518b-2d5c-4b26-840c-49913d89ad0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:06.050493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8832518b-2d5c-4b26-840c-49913d89ad0c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.127979 Dec 24 05:03:06.051112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 375/696] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:05 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:06.167311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c7469afe-2286-45e9-921b-8551cffa94de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:06.168296 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c7469afe-2286-45e9-921b-8551cffa94de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:06.174750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7469afe-2286-45e9-921b-8551cffa94de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:06.175181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7469afe-2286-45e9-921b-8551cffa94de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:06.175946 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7469afe-2286-45e9-921b-8551cffa94de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:06.176367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7469afe-2286-45e9-921b-8551cffa94de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:06.207101 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c7469afe-2286-45e9-921b-8551cffa94de tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Dec 24 05:03:06.207585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 322/697] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:06 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:06.443475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6aaac54f-8307-4c5e-bece-cf1e49f1ae23 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:06.444673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6aaac54f-8307-4c5e-bece-cf1e49f1ae23 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:06.452433 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6aaac54f-8307-4c5e-bece-cf1e49f1ae23 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:06.452888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6aaac54f-8307-4c5e-bece-cf1e49f1ae23 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:06.453681 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6aaac54f-8307-4c5e-bece-cf1e49f1ae23 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:06.454111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6aaac54f-8307-4c5e-bece-cf1e49f1ae23 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:06.485404 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6aaac54f-8307-4c5e-bece-cf1e49f1ae23 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046873 Dec 24 05:03:06.485893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 376/698] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:06 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:07.065562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0c11ac74-c4f8-43d8-9150-3e97801fa161 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:07.066831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0c11ac74-c4f8-43d8-9150-3e97801fa161 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:07.076089 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c11ac74-c4f8-43d8-9150-3e97801fa161 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:07.076556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c11ac74-c4f8-43d8-9150-3e97801fa161 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:07.077343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c11ac74-c4f8-43d8-9150-3e97801fa161 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:07.077770 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c11ac74-c4f8-43d8-9150-3e97801fa161 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:07.220585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0c11ac74-c4f8-43d8-9150-3e97801fa161 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.159612 Dec 24 05:03:07.221626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 323/699] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:07 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:07.223478 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1d511d06-c10f-4112-83f9-75e761702442 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:07.225081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1d511d06-c10f-4112-83f9-75e761702442 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:07.234257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d511d06-c10f-4112-83f9-75e761702442 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:07.234701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d511d06-c10f-4112-83f9-75e761702442 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:07.235476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d511d06-c10f-4112-83f9-75e761702442 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:07.235904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d511d06-c10f-4112-83f9-75e761702442 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:07.265308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1d511d06-c10f-4112-83f9-75e761702442 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048450 Dec 24 05:03:07.265858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 377/700] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:07 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:07.497474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6a3eda11-7538-4b32-bb23-3365acbd4d5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:07.498463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6a3eda11-7538-4b32-bb23-3365acbd4d5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:07.505323 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a3eda11-7538-4b32-bb23-3365acbd4d5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:07.505761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a3eda11-7538-4b32-bb23-3365acbd4d5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:07.506529 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a3eda11-7538-4b32-bb23-3365acbd4d5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:07.506951 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a3eda11-7538-4b32-bb23-3365acbd4d5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:07.537848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6a3eda11-7538-4b32-bb23-3365acbd4d5f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Dec 24 05:03:07.538427 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 324/701] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:07 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:08.234932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1265eb46-5069-41c6-9f4c-9c841937ae0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:08.235853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1265eb46-5069-41c6-9f4c-9c841937ae0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:08.242052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1265eb46-5069-41c6-9f4c-9c841937ae0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:08.242483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1265eb46-5069-41c6-9f4c-9c841937ae0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:08.243227 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1265eb46-5069-41c6-9f4c-9c841937ae0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:08.243832 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1265eb46-5069-41c6-9f4c-9c841937ae0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:08.276198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c8a36c30-84c2-443c-81c5-cd19527aaa42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:08.277262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c8a36c30-84c2-443c-81c5-cd19527aaa42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:08.283789 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a36c30-84c2-443c-81c5-cd19527aaa42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:08.284233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a36c30-84c2-443c-81c5-cd19527aaa42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:08.285033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a36c30-84c2-443c-81c5-cd19527aaa42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:08.285474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a36c30-84c2-443c-81c5-cd19527aaa42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:08.315541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c8a36c30-84c2-443c-81c5-cd19527aaa42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Dec 24 05:03:08.319371 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 325/702] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:08 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:03:08.373154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1265eb46-5069-41c6-9f4c-9c841937ae0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.141739 Dec 24 05:03:08.374020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 378/703] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:08 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:08.550107 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4f7fc6c5-7c34-4b72-8fb2-568fd58f3de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:08.551025 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4f7fc6c5-7c34-4b72-8fb2-568fd58f3de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:08.557492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f7fc6c5-7c34-4b72-8fb2-568fd58f3de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:08.557962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f7fc6c5-7c34-4b72-8fb2-568fd58f3de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:08.558734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f7fc6c5-7c34-4b72-8fb2-568fd58f3de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:08.559166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f7fc6c5-7c34-4b72-8fb2-568fd58f3de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:08.593097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4f7fc6c5-7c34-4b72-8fb2-568fd58f3de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046674 Dec 24 05:03:08.593657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 326/704] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:08 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:03:09.326664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d174cdc1-e8fa-41fd-b86d-f32a2e20d46d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:09.327657 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d174cdc1-e8fa-41fd-b86d-f32a2e20d46d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:09.335266 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d174cdc1-e8fa-41fd-b86d-f32a2e20d46d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:09.335709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d174cdc1-e8fa-41fd-b86d-f32a2e20d46d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:09.336464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d174cdc1-e8fa-41fd-b86d-f32a2e20d46d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:09.336917 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d174cdc1-e8fa-41fd-b86d-f32a2e20d46d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:09.366988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d174cdc1-e8fa-41fd-b86d-f32a2e20d46d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Dec 24 05:03:09.367552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 379/705] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:09 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:09.385239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4cf93229-d5fa-47a8-8a90-0cc7cef9b19f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:09.386278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4cf93229-d5fa-47a8-8a90-0cc7cef9b19f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:09.392606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cf93229-d5fa-47a8-8a90-0cc7cef9b19f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:09.393056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cf93229-d5fa-47a8-8a90-0cc7cef9b19f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:09.393815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cf93229-d5fa-47a8-8a90-0cc7cef9b19f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:09.394246 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4cf93229-d5fa-47a8-8a90-0cc7cef9b19f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:09.511013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4cf93229-d5fa-47a8-8a90-0cc7cef9b19f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.129485 Dec 24 05:03:09.511791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 327/706] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:09 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:09.604556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-87fcc3bd-82c8-44af-94c1-687445d0340b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:09.605779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-87fcc3bd-82c8-44af-94c1-687445d0340b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:09.612192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87fcc3bd-82c8-44af-94c1-687445d0340b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:09.612672 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87fcc3bd-82c8-44af-94c1-687445d0340b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:09.613497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87fcc3bd-82c8-44af-94c1-687445d0340b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:09.613918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87fcc3bd-82c8-44af-94c1-687445d0340b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:09.644100 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-87fcc3bd-82c8-44af-94c1-687445d0340b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Dec 24 05:03:09.644669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 380/707] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:09 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:10.381901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3437380d-f31d-4dce-b5a8-404d61c32a19 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:10.383203 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3437380d-f31d-4dce-b5a8-404d61c32a19 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:10.392696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3437380d-f31d-4dce-b5a8-404d61c32a19 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:10.393476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3437380d-f31d-4dce-b5a8-404d61c32a19 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:10.394298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3437380d-f31d-4dce-b5a8-404d61c32a19 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:10.394853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3437380d-f31d-4dce-b5a8-404d61c32a19 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:10.427905 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3437380d-f31d-4dce-b5a8-404d61c32a19 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051496 Dec 24 05:03:10.428455 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 328/708] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:10 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:10.527050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0150ec92-9bd7-46ea-ba59-cbc954107e94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:10.528421 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0150ec92-9bd7-46ea-ba59-cbc954107e94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:10.535082 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0150ec92-9bd7-46ea-ba59-cbc954107e94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:10.535521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0150ec92-9bd7-46ea-ba59-cbc954107e94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:10.536285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0150ec92-9bd7-46ea-ba59-cbc954107e94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:10.536747 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0150ec92-9bd7-46ea-ba59-cbc954107e94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:10.627133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0150ec92-9bd7-46ea-ba59-cbc954107e94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 28622 microversion: 2.20 time: 0.106121 Dec 24 05:03:10.627802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 381/709] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:10 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 28622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:10.655855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c86901a2-6235-4bec-b12b-0e59e7079a09 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:10.656800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c86901a2-6235-4bec-b12b-0e59e7079a09 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:10.663196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c86901a2-6235-4bec-b12b-0e59e7079a09 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:10.663639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c86901a2-6235-4bec-b12b-0e59e7079a09 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:10.664407 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c86901a2-6235-4bec-b12b-0e59e7079a09 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:10.664864 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c86901a2-6235-4bec-b12b-0e59e7079a09 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:10.694166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c86901a2-6235-4bec-b12b-0e59e7079a09 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Dec 24 05:03:10.694727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 329/710] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:10 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:11.444042 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8654baa3-69bc-4006-9fd8-3fa37aa07003 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:11.445744 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8654baa3-69bc-4006-9fd8-3fa37aa07003 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:11.454312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8654baa3-69bc-4006-9fd8-3fa37aa07003 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:11.454746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8654baa3-69bc-4006-9fd8-3fa37aa07003 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:11.455513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8654baa3-69bc-4006-9fd8-3fa37aa07003 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:11.455935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8654baa3-69bc-4006-9fd8-3fa37aa07003 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:11.486046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8654baa3-69bc-4006-9fd8-3fa37aa07003 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048827 Dec 24 05:03:11.486582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 382/711] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:11 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:11.640812 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bac6d81f-d991-4ecb-bc9e-34823e362571 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:11.641850 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bac6d81f-d991-4ecb-bc9e-34823e362571 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:11.648558 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bac6d81f-d991-4ecb-bc9e-34823e362571 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:11.649009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bac6d81f-d991-4ecb-bc9e-34823e362571 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:11.649957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bac6d81f-d991-4ecb-bc9e-34823e362571 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:11.650392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bac6d81f-d991-4ecb-bc9e-34823e362571 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:11.705606 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ca19bcf6-e1cd-4a72-a4bc-d4ba26fecf3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:11.706559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ca19bcf6-e1cd-4a72-a4bc-d4ba26fecf3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:11.713118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca19bcf6-e1cd-4a72-a4bc-d4ba26fecf3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:11.713565 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca19bcf6-e1cd-4a72-a4bc-d4ba26fecf3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:11.714381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca19bcf6-e1cd-4a72-a4bc-d4ba26fecf3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:11.714809 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca19bcf6-e1cd-4a72-a4bc-d4ba26fecf3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:11.749177 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ca19bcf6-e1cd-4a72-a4bc-d4ba26fecf3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Dec 24 05:03:11.749760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 383/712] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:11 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:11.759664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bac6d81f-d991-4ecb-bc9e-34823e362571 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 30017 microversion: 2.20 time: 0.123029 Dec 24 05:03:11.760517 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 330/713] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:11 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 30017 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:12.499856 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2165c2c3-604e-481f-b892-059432a600c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:12.500766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2165c2c3-604e-481f-b892-059432a600c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:12.507681 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2165c2c3-604e-481f-b892-059432a600c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:12.508152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2165c2c3-604e-481f-b892-059432a600c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:12.509073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2165c2c3-604e-481f-b892-059432a600c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:12.509519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2165c2c3-604e-481f-b892-059432a600c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:12.539787 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2165c2c3-604e-481f-b892-059432a600c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Dec 24 05:03:12.540333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 384/714] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:12 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:12.772390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-be40c24e-990b-4aef-b45a-ddfc11ffb8a6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:12.774194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-be40c24e-990b-4aef-b45a-ddfc11ffb8a6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:12.776922 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b6848abd-afc0-45bd-9231-c94e989ab58f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:12.778802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b6848abd-afc0-45bd-9231-c94e989ab58f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:12.782843 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be40c24e-990b-4aef-b45a-ddfc11ffb8a6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:12.783293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be40c24e-990b-4aef-b45a-ddfc11ffb8a6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:12.784082 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be40c24e-990b-4aef-b45a-ddfc11ffb8a6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:12.784548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-be40c24e-990b-4aef-b45a-ddfc11ffb8a6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:12.786456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6848abd-afc0-45bd-9231-c94e989ab58f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:12.786900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6848abd-afc0-45bd-9231-c94e989ab58f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:12.787681 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6848abd-afc0-45bd-9231-c94e989ab58f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:12.788111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6848abd-afc0-45bd-9231-c94e989ab58f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:12.815791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-be40c24e-990b-4aef-b45a-ddfc11ffb8a6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057097 Dec 24 05:03:12.816329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 331/715] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:12 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:12.899010 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b6848abd-afc0-45bd-9231-c94e989ab58f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 32577 microversion: 2.20 time: 0.129807 Dec 24 05:03:12.899654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 385/716] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:12 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 32577 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:13.555300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fbd50e92-427a-4f6d-bfcd-f67b3e3b7b20 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:13.556748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fbd50e92-427a-4f6d-bfcd-f67b3e3b7b20 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:13.564283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fbd50e92-427a-4f6d-bfcd-f67b3e3b7b20 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:13.564769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fbd50e92-427a-4f6d-bfcd-f67b3e3b7b20 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:13.565538 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fbd50e92-427a-4f6d-bfcd-f67b3e3b7b20 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:13.565959 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fbd50e92-427a-4f6d-bfcd-f67b3e3b7b20 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:13.595700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fbd50e92-427a-4f6d-bfcd-f67b3e3b7b20 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046693 Dec 24 05:03:13.596243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 332/717] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:13 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:13.831269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-67563d03-b591-4cc9-949a-56ad49c51885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:13.832175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-67563d03-b591-4cc9-949a-56ad49c51885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:13.839579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67563d03-b591-4cc9-949a-56ad49c51885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:13.840047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67563d03-b591-4cc9-949a-56ad49c51885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:13.840803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67563d03-b591-4cc9-949a-56ad49c51885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:13.841221 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67563d03-b591-4cc9-949a-56ad49c51885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:13.871726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-67563d03-b591-4cc9-949a-56ad49c51885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Dec 24 05:03:13.872265 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 386/718] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:13 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:13.911031 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1a470d2e-adc4-435e-a0e2-154181514748 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:13.911932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1a470d2e-adc4-435e-a0e2-154181514748 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:13.918714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a470d2e-adc4-435e-a0e2-154181514748 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:13.919153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a470d2e-adc4-435e-a0e2-154181514748 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:13.919886 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a470d2e-adc4-435e-a0e2-154181514748 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:13.920342 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a470d2e-adc4-435e-a0e2-154181514748 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:14.057990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1a470d2e-adc4-435e-a0e2-154181514748 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 33718 microversion: 2.20 time: 0.150420 Dec 24 05:03:14.058679 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 333/719] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:13 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 33718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:03:14.607743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f6bc453a-a8f1-4201-8ea2-79f72777a019 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:14.608700 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f6bc453a-a8f1-4201-8ea2-79f72777a019 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:14.615209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6bc453a-a8f1-4201-8ea2-79f72777a019 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:14.615673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6bc453a-a8f1-4201-8ea2-79f72777a019 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:14.616441 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6bc453a-a8f1-4201-8ea2-79f72777a019 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:14.616897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6bc453a-a8f1-4201-8ea2-79f72777a019 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:14.648267 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f6bc453a-a8f1-4201-8ea2-79f72777a019 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Dec 24 05:03:14.648950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 387/720] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:14 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:14.886695 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-74941da2-56fd-4be8-9b13-72739414effc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:14.887860 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-74941da2-56fd-4be8-9b13-72739414effc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:14.897341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74941da2-56fd-4be8-9b13-72739414effc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:14.897965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74941da2-56fd-4be8-9b13-72739414effc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:14.899185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74941da2-56fd-4be8-9b13-72739414effc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:14.899868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74941da2-56fd-4be8-9b13-72739414effc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:14.930644 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-74941da2-56fd-4be8-9b13-72739414effc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049392 Dec 24 05:03:14.931293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 334/721] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:14 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:03:15.070717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dffbfaa9-261f-4a19-82f6-42fb9bd8d6aa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:15.071626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dffbfaa9-261f-4a19-82f6-42fb9bd8d6aa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:15.078462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dffbfaa9-261f-4a19-82f6-42fb9bd8d6aa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:15.078910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dffbfaa9-261f-4a19-82f6-42fb9bd8d6aa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:15.079678 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dffbfaa9-261f-4a19-82f6-42fb9bd8d6aa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:15.080134 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dffbfaa9-261f-4a19-82f6-42fb9bd8d6aa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:15.219342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dffbfaa9-261f-4a19-82f6-42fb9bd8d6aa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 34245 microversion: 2.20 time: 0.152734 Dec 24 05:03:15.219887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 388/722] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:15 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 34245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:15.318300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-715e7a2d-77b4-4025-bd2f-4132ae8b5a51 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e58ed276-3e76-4a7c-af94-a92aee3a6a03", "device": "/dev/sdb"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:15.319881 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-715e7a2d-77b4-4025-bd2f-4132ae8b5a51 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:15.327089 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-715e7a2d-77b4-4025-bd2f-4132ae8b5a51 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:15.327532 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-715e7a2d-77b4-4025-bd2f-4132ae8b5a51 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:15.328334 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-715e7a2d-77b4-4025-bd2f-4132ae8b5a51 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:15.328785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-715e7a2d-77b4-4025-bd2f-4132ae8b5a51 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:15.618935 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-715e7a2d-77b4-4025-bd2f-4132ae8b5a51 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "POST /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304451 Dec 24 05:03:15.619496 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 335/723] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:03:15 2021] POST /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:15.660011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-54bb9b9a-d55a-474b-a3d3-73e51463ab38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:15.661103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-54bb9b9a-d55a-474b-a3d3-73e51463ab38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:15.669570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54bb9b9a-d55a-474b-a3d3-73e51463ab38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:15.669570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54bb9b9a-d55a-474b-a3d3-73e51463ab38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:15.670311 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54bb9b9a-d55a-474b-a3d3-73e51463ab38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:15.670867 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-54bb9b9a-d55a-474b-a3d3-73e51463ab38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:15.702930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-54bb9b9a-d55a-474b-a3d3-73e51463ab38 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047152 Dec 24 05:03:15.703494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 389/724] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:15 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:16.231785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e59473bc-c131-42e6-98a6-ca787f080bef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:16.233440 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e59473bc-c131-42e6-98a6-ca787f080bef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:16.239586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e59473bc-c131-42e6-98a6-ca787f080bef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:16.240049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e59473bc-c131-42e6-98a6-ca787f080bef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:16.240856 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e59473bc-c131-42e6-98a6-ca787f080bef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:16.241282 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e59473bc-c131-42e6-98a6-ca787f080bef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:16.367268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e59473bc-c131-42e6-98a6-ca787f080bef tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 34822 microversion: 2.20 time: 0.139924 Dec 24 05:03:16.367904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 336/725] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:16 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 34822 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:16.714964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1bdee90d-8385-434e-be29-3700d41de800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:16.715878 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1bdee90d-8385-434e-be29-3700d41de800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:16.722850 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1bdee90d-8385-434e-be29-3700d41de800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:16.723509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1bdee90d-8385-434e-be29-3700d41de800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:16.724643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1bdee90d-8385-434e-be29-3700d41de800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:16.725370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1bdee90d-8385-434e-be29-3700d41de800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:16.756918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1bdee90d-8385-434e-be29-3700d41de800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045790 Dec 24 05:03:16.758514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 390/726] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:03:16 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:03:17.265836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:17.266436 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:17.273474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:17.273909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:17.274666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:17.275089 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:17.300269 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:03:17.379217 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a247084f-aa26-4fed-85dd-d2d5af498aaf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "DELETE /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 204 len: 0 microversion: 2.1 time: 0.117402 Dec 24 05:03:17.380006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0a95670f-081d-43aa-bbb8-dd6c4db45d39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:17.380350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 337/727] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:03:17 2021] DELETE /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:03:17.381101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0a95670f-081d-43aa-bbb8-dd6c4db45d39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:17.388817 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a95670f-081d-43aa-bbb8-dd6c4db45d39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:17.389259 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a95670f-081d-43aa-bbb8-dd6c4db45d39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:17.390044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a95670f-081d-43aa-bbb8-dd6c4db45d39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:17.390464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a95670f-081d-43aa-bbb8-dd6c4db45d39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:17.391374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:17.392075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:17.398179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:17.398628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:17.399423 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:17.399852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:17.541848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:17.550742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a4ca4415-9d9d-4014-a282-5449f939bc12 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.165267 Dec 24 05:03:17.551301 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 338/728] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:17 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:17.596488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0a95670f-081d-43aa-bbb8-dd6c4db45d39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 35669 microversion: 2.20 time: 0.220234 Dec 24 05:03:17.597184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 391/729] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:17 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 35669 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:03:18.568604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:18.569275 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:18.575817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:18.576205 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:18.577011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:18.577442 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:18.608627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-90b784fe-e499-413e-a2ce-6a09e1400539 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:18.609673 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-90b784fe-e499-413e-a2ce-6a09e1400539 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:18.616581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90b784fe-e499-413e-a2ce-6a09e1400539 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:18.617018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90b784fe-e499-413e-a2ce-6a09e1400539 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:18.617819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90b784fe-e499-413e-a2ce-6a09e1400539 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:18.618236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-90b784fe-e499-413e-a2ce-6a09e1400539 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:18.711630 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:18.719164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.154864 Dec 24 05:03:18.719798 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 339/730] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:18 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:18.729075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-90b784fe-e499-413e-a2ce-6a09e1400539 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 36565 microversion: 2.20 time: 0.124213 Dec 24 05:03:18.729728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 392/731] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:18 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 36565 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:19.020618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:19.021117 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:19.027630 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.028061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.028897 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.029324 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.053946 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:03:19.140021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ee1dda5e-1149-4d2c-b407-d0160b594a5e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 204 len: 0 microversion: 2.1 time: 0.122699 Dec 24 05:03:19.140772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 340/732] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:03:19 2021] DELETE /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:03:19.149551 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:19.150624 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:19.157799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.158490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.159346 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.159770 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.322574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:19.330418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-efd72274-872f-4465-b24a-b3ad3434212d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1513 microversion: 2.1 time: 0.184894 Dec 24 05:03:19.330947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 393/733] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:19 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:19.741020 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:19.741964 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:19.744272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d6b8c811-cfaf-464c-92ef-47b8c9e32643 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:19.745955 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d6b8c811-cfaf-464c-92ef-47b8c9e32643 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:19.751563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.752247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.753503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.754171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.756325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6b8c811-cfaf-464c-92ef-47b8c9e32643 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.757047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6b8c811-cfaf-464c-92ef-47b8c9e32643 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.758218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6b8c811-cfaf-464c-92ef-47b8c9e32643 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:19.758864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d6b8c811-cfaf-464c-92ef-47b8c9e32643 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:19.873231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d6b8c811-cfaf-464c-92ef-47b8c9e32643 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 37585 microversion: 2.20 time: 0.134118 Dec 24 05:03:19.877378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 394/734] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:19 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 37585 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:19.891033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:19.898895 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.164802 Dec 24 05:03:19.899679 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 341/735] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:19 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:20.347893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:20.348670 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:20.355872 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:20.356380 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:20.357228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:20.357658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:20.504098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:20.512167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1513 microversion: 2.1 time: 0.168464 Dec 24 05:03:20.512876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 395/736] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:20 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:20.891537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d13eea55-7989-4eb5-9080-34047160cbc1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:20.893129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d13eea55-7989-4eb5-9080-34047160cbc1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:20.904015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d13eea55-7989-4eb5-9080-34047160cbc1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:20.904598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d13eea55-7989-4eb5-9080-34047160cbc1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:20.905292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d13eea55-7989-4eb5-9080-34047160cbc1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:20.905727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d13eea55-7989-4eb5-9080-34047160cbc1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:20.916483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:20.917143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:20.923915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:20.924365 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:20.925186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:20.925821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:21.063298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:21.071402 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.158761 Dec 24 05:03:21.071976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 396/737] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:20 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:21.532244 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:21.533005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:21.541431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:21.541996 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:21.542977 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:21.543520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:21.694572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:21.705868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6138f24d-3c90-463e-b132-d39273cf2892 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1513 microversion: 2.1 time: 0.178744 Dec 24 05:03:21.706698 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 397/738] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:21 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:22.092988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:22.094040 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:22.104582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:22.105334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:22.106802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:22.107264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:22.244999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:22.253226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8dc3e002-1949-4508-a5b3-b84b01387989 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.167107 Dec 24 05:03:22.253792 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 398/739] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:22 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:22.730443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:22.731439 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:22.739071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:22.739514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:22.740263 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:22.740746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:22.891073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:22.898997 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75d44cdf-9826-4a95-b177-fac3231a6835 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1513 microversion: 2.1 time: 0.174809 Dec 24 05:03:22.899587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 399/740] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:22 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:23.271659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:23.272318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:23.278991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:23.279425 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:23.280188 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:23.280648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:23.416036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:23.423644 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.155689 Dec 24 05:03:23.424217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 400/741] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:23 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:23.916849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:23.917568 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:23.924737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:23.925188 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:23.925954 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:23.926387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:24.075643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:24.087073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8e2a3880-9cbc-4681-b73f-47ed97adb503 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1513 microversion: 2.1 time: 0.174265 Dec 24 05:03:24.087943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 401/742] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:23 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:24.161675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d13eea55-7989-4eb5-9080-34047160cbc1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 38170 microversion: 2.20 time: 3.278034 Dec 24 05:03:24.162401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 342/743] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:20 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 38170 bytes in 3280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:24.445226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:24.447021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:24.456456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:24.456925 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:24.457698 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:24.458118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:24.603690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:24.611467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-635a1016-6243-460a-900b-ff31ecf365e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.172582 Dec 24 05:03:24.612028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 402/744] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:24 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:25.104233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:25.105174 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:25.113366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:25.114795 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:25.115531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:25.115965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:25.173893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fc4600f8-78fc-4bfd-9552-85bf721cc261 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:25.174805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fc4600f8-78fc-4bfd-9552-85bf721cc261 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:25.181199 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc4600f8-78fc-4bfd-9552-85bf721cc261 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:25.181739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc4600f8-78fc-4bfd-9552-85bf721cc261 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:25.182519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc4600f8-78fc-4bfd-9552-85bf721cc261 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:25.182935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc4600f8-78fc-4bfd-9552-85bf721cc261 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:25.269576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:25.277379 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-55ed044c-35c4-4f76-b658-6962e7399de2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1513 microversion: 2.1 time: 0.177669 Dec 24 05:03:25.277970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 343/745] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:25 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:25.409891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fc4600f8-78fc-4bfd-9552-85bf721cc261 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 38170 microversion: 2.20 time: 0.239761 Dec 24 05:03:25.410579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 403/746] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:25 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 38170 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:03:25.629346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:25.629969 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:25.636699 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:25.637215 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:25.637941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:25.638420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.117692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:26.125262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-08a22980-9a1e-439a-90a9-e38f0b2bb24c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1506 microversion: 2.1 time: 0.500475 Dec 24 05:03:26.126180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 344/747] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:25 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:26.300350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:26.301824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:26.322967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:26.323595 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.324569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:26.325148 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.342585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-7c563bfa-ba22-40c3-9248-b37e8957e0b4 req-9ac90b96-61ce-4be6-97e7-42feebd0054f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "name": "network-vif-deleted", "tag": "24d08627-8243-4361-b6b4-8461a18d110f"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:26.344126 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:26.344126 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:03:26.357856 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-7c563bfa-ba22-40c3-9248-b37e8957e0b4 req-9ac90b96-61ce-4be6-97e7-42feebd0054f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:26.358290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-7c563bfa-ba22-40c3-9248-b37e8957e0b4 req-9ac90b96-61ce-4be6-97e7-42feebd0054f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.400495 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-7c563bfa-ba22-40c3-9248-b37e8957e0b4 req-9ac90b96-61ce-4be6-97e7-42feebd0054f service nova] Creating event network-vif-deleted:24d08627-8243-4361-b6b4-8461a18d110f for instance 580344bb-42e6-4fd7-967d-04e85d821fd2 on hv-cinder-81644 Dec 24 05:03:26.405656 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-7c563bfa-ba22-40c3-9248-b37e8957e0b4 req-9ac90b96-61ce-4be6-97e7-42feebd0054f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066778 Dec 24 05:03:26.406700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 345/748] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:03:26.422717 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fb2a2354-09d4-4a35-a731-06276f2d03f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:26.425542 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fb2a2354-09d4-4a35-a731-06276f2d03f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:26.433360 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fb2a2354-09d4-4a35-a731-06276f2d03f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:26.446524 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fb2a2354-09d4-4a35-a731-06276f2d03f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.446524 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fb2a2354-09d4-4a35-a731-06276f2d03f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:26.446524 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fb2a2354-09d4-4a35-a731-06276f2d03f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.531001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:26.538442 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1513 microversion: 2.1 time: 0.244680 Dec 24 05:03:26.540731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 404/749] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:26 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:26.578576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fb2a2354-09d4-4a35-a731-06276f2d03f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 200 len: 38311 microversion: 2.20 time: 0.159959 Dec 24 05:03:26.579262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 346/750] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:26 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 38311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:03:26.590235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2609ea1d-e6fa-415a-9e1a-859e412f7068 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:26.590880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2609ea1d-e6fa-415a-9e1a-859e412f7068 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:26.597661 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2609ea1d-e6fa-415a-9e1a-859e412f7068 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:26.598106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2609ea1d-e6fa-415a-9e1a-859e412f7068 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.598891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2609ea1d-e6fa-415a-9e1a-859e412f7068 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:26.599322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2609ea1d-e6fa-415a-9e1a-859e412f7068 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:26.623156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2609ea1d-e6fa-415a-9e1a-859e412f7068 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/ips" status: 200 len: 150 microversion: 2.20 time: 0.036730 Dec 24 05:03:26.623733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 405/751] 10.222.0.43 () {60 vars in 1288 bytes} [Fri Dec 24 05:03:26 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 05:03:27.144431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:27.145361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:27.155980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:27.156984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:27.158765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:27.159384 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:27.196716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:27.197293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:27.197849 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lazy-loading 'fault' on Instance uuid 580344bb-42e6-4fd7-967d-04e85d821fd2 {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:27.240166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:27.247974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 200 len: 1310 microversion: 2.1 time: 0.107995 Dec 24 05:03:27.248821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 347/752] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:27 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:27.563290 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:27.563919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:27.571400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:27.571900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:27.573434 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:27.573951 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:27.609836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:27.610265 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:27.610696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'fault' on Instance uuid 6e67ec17-823b-4612-8bd4-dbe278717d5e {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:27.654369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:27.661400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5bf187cd-3391-4042-92c3-b68be980ca2d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 200 len: 1307 microversion: 2.1 time: 0.108768 Dec 24 05:03:27.661969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 406/753] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:27 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:28.269427 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:28.270033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 580344bb-42e6-4fd7-967d-04e85d821fd2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:28.276839 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.277298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.278074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.278501 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.292437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] HTTP exception thrown: Instance 580344bb-42e6-4fd7-967d-04e85d821fd2 could not be found. Dec 24 05:03:28.293051 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Returning 404 to user: Instance 580344bb-42e6-4fd7-967d-04e85d821fd2 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:03:28.293915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-445b8f0d-eb69-4721-bebd-3c6fd1ac8fd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2" status: 404 len: 111 microversion: 2.1 time: 0.029914 Dec 24 05:03:28.294417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 348/754] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:28 2021] GET /compute/v2.1/servers/580344bb-42e6-4fd7-967d-04e85d821fd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:03:28.303248 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:28.303738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:28.310267 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.310718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.311511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.311944 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.337780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:03:28.422737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 204 len: 0 microversion: 2.1 time: 0.123668 Dec 24 05:03:28.423362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 407/755] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:03:28 2021] DELETE /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:03:28.432399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:28.433136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:28.439244 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-14f0d67e-375a-42e8-b799-365121111937 req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "name": "network-vif-deleted", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:28.439892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.440710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.440899 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:28.440899 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:03:28.441501 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.441924 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.447753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-14f0d67e-375a-42e8-b799-365121111937 req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.448210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-14f0d67e-375a-42e8-b799-365121111937 req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.459299 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-14f0d67e-375a-42e8-b799-365121111937 req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 service nova] Creating event network-vif-deleted:7484fcf7-0384-4cf4-8974-7df317686b39 for instance 6e67ec17-823b-4612-8bd4-dbe278717d5e on hv-cinder-81644 Dec 24 05:03:28.464681 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-14f0d67e-375a-42e8-b799-365121111937 req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029429 Dec 24 05:03:28.465323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 408/756] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:28.574974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:28.583236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.154974 Dec 24 05:03:28.583813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 349/757] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:28 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:28.678275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:28.678953 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 6e67ec17-823b-4612-8bd4-dbe278717d5e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:28.685682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.686112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.686883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:28.687328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:28.700583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] HTTP exception thrown: Instance 6e67ec17-823b-4612-8bd4-dbe278717d5e could not be found. Dec 24 05:03:28.701185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Returning 404 to user: Instance 6e67ec17-823b-4612-8bd4-dbe278717d5e could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:03:28.701997 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-06131070-a92b-40bc-b636-357d4e8f30a7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e" status: 404 len: 111 microversion: 2.1 time: 0.027894 Dec 24 05:03:28.702522 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 409/758] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:28 2021] GET /compute/v2.1/servers/6e67ec17-823b-4612-8bd4-dbe278717d5e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:03:29.325540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:29.326078 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:29.332890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:29.333328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:29.334114 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:29.334545 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:29.357777 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lazy-loading 'flavor' on Instance uuid 6485c286-d5e3-42e7-bf58-c4685f8c3066 {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:29.604967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:29.606611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:29.614994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:29.615481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:29.616385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:29.616920 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:29.645805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 202 len: 0 microversion: 2.20 time: 0.324013 Dec 24 05:03:29.646441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 350/759] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:03:29 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:03:29.655485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:29.656457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:29.663356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:29.663872 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:29.664737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:29.665308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:29.760049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:29.768874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5dc2513a-f692-42e0-bba5-254789bd329c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.170257 Dec 24 05:03:29.769454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 410/760] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:29 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:29.800420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:29.808724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:29.810128 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:29.811261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.159885 Dec 24 05:03:29.811809 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 351/761] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:29 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:03:30.789715 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:30.790358 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:30.797512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:30.797975 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:30.798781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:30.799223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:30.830195 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:30.830912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:30.838234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:30.838708 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:30.839519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:30.839951 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:30.932494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:30.940202 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0bd5ac06-734d-40b2-81a8-570c99940e07 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.156410 Dec 24 05:03:30.940969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 411/762] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:30 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:30.979120 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:30.987672 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:30.989153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:30.990318 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.163896 Dec 24 05:03:30.991004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 352/763] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:30 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:31.956905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:31.957520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:31.965001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:31.965444 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:31.966219 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:31.966651 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:32.010821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:32.011915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:32.019625 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:32.020039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:32.020892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:32.021310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:32.102251 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:32.111021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ab494a58-1a56-409c-bfc0-b459b24cc9af tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.157847 Dec 24 05:03:32.111598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 412/764] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:31 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:32.159003 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:32.167428 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:32.168914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:32.170133 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e8d41289-a264-4d75-8846-a5d95460d644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.163969 Dec 24 05:03:32.170621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 353/765] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:32 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:03:33.129755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:33.130630 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:33.137648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:33.138091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:33.138865 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:33.139294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:33.187588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:33.188164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:33.194831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:33.195263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:33.196145 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:33.196559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:33.281610 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:33.289411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0bb1403e-5b63-415f-a5c8-2d18f5860781 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.164075 Dec 24 05:03:33.289515 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 413/766] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:33 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:33.335591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:33.344735 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:33.346380 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:33.347683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4fb0e1a1-6369-4220-9392-1f7b736df323 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.163943 Dec 24 05:03:33.348255 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 354/767] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:33 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:34.045798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:34.046305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:34.053718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.054366 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.055384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.055831 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.081412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:03:34.156346 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bfad08eb-f280-40c5-bda4-87f3349d125c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 204 len: 0 microversion: 2.1 time: 0.114093 Dec 24 05:03:34.159792 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 414/768] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:03:34 2021] DELETE /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:03:34.173933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:34.174585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:34.181261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.181705 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.182516 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.182946 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.307313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:34.308006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:34.318303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.318751 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.319539 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.319969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.324457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:34.333675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1513 microversion: 2.1 time: 0.172504 Dec 24 05:03:34.334332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 355/769] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:34 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:34.366527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:34.367220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:34.373731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.374287 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.375143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:34.375642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:34.517056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:34.525947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:34.527431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:34.528645 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e46b8b55-851c-4fea-a672-0397ea34b549 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.165808 Dec 24 05:03:34.529180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 356/770] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:34 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:34.636429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:34.644380 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.341620 Dec 24 05:03:34.644979 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 415/771] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:34 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:35.351350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:35.352012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:35.359092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:35.359531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:35.360341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:35.360802 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:35.496108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:35.503508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-eb731b49-c957-4fac-8ed3-d993634a0205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1513 microversion: 2.1 time: 0.155965 Dec 24 05:03:35.504066 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 357/772] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:35 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:35.550335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:35.551130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:35.559660 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:35.560106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:35.561468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:35.561909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:35.660805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:35.661409 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:35.667878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:35.668330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:35.669152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:35.669580 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:35.695175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:35.703161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:35.704652 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:35.705785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.162130 Dec 24 05:03:35.706336 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 416/773] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:35 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:35.807833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:35.815314 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-41f7d0e3-9224-4c11-9ab6-68804b436410 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.158207 Dec 24 05:03:35.815887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 358/774] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:35 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:36.524383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:36.525204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:36.531971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:36.532437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:36.533269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:36.533710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:36.669276 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:36.677171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-672e40c1-d383-4039-a6a2-86ee17264438 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1513 microversion: 2.1 time: 0.158875 Dec 24 05:03:36.677727 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 417/775] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:36 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:36.726982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:36.727600 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:36.734522 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:36.734964 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:36.735734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:36.736155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:36.834164 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:36.834764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:36.841848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:36.842283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:36.843062 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:36.843484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:36.879343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:36.888137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:36.889645 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:36.890822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.169841 Dec 24 05:03:36.891397 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 359/776] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:36 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:36.989376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:36.997400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae5b29ac-0fa2-456d-ac37-d234138dba71 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.167446 Dec 24 05:03:36.998800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 418/777] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:36 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:37.697143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:37.697785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:37.704233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:37.704702 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:37.705500 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:37.705922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:37.840757 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:37.848215 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cda93e06-c548-43d9-b65f-d55d4169fd51 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1513 microversion: 2.1 time: 0.157191 Dec 24 05:03:37.848831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 360/778] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:37 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:37.909069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:37.909631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:37.916290 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:37.916768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:37.917526 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:37.917943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:38.014262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:38.014955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:38.021457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:38.021900 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:38.022683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:38.023107 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:38.060210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:38.068372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:38.070191 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:38.071407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9685d5cf-1315-46d8-8ccd-b5ae709f573c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.166035 Dec 24 05:03:38.072061 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 419/779] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:37 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:38.158985 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:38.167215 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.156795 Dec 24 05:03:38.167772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 361/780] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:38 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:38.869808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:38.870404 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:38.876322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:38.876805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:38.877562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:38.878005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:39.012847 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:39.020752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1513 microversion: 2.1 time: 0.154634 Dec 24 05:03:39.021313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 420/781] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:38 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:39.090239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:39.090865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:39.097479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:39.097919 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:39.098823 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:39.099352 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:39.183864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:39.184398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:39.191314 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:39.192025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:39.192964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:39.193494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:39.244280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:39.252458 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:39.253981 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:39.255106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.168776 Dec 24 05:03:39.255699 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 362/782] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:39 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:39.328583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:39.336117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-166e8b5b-7290-465c-a165-13fcf701c829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.156599 Dec 24 05:03:39.336691 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 421/783] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:39 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:40.038055 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:40.038708 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:40.045517 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:40.046015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:40.046877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:40.047329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:40.193234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:40.201517 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1513 microversion: 2.1 time: 0.167383 Dec 24 05:03:40.202080 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 363/784] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:40 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:40.277864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:40.278497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:40.285117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:40.285560 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:40.286335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:40.286761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:40.353012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:40.354044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:40.361050 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:40.362317 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:40.363131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:40.363618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:40.428408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:40.436630 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:40.438107 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:40.439296 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-53c2f008-777d-430e-b017-5f574eaaaf4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.165786 Dec 24 05:03:40.439866 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 422/785] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:40 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:40.582696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:40.590376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5657b688-1d99-4233-8d4a-da01373ed228 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.241054 Dec 24 05:03:40.590914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 364/786] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:40 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:40.849297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-71f68db6-9d0c-44c6-995e-0957615c2ee9 req-e39b0056-6fc0-4843-bd85-2b47b6ad276b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "name": "network-vif-deleted", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:40.850871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:40.850871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:03:40.858158 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-71f68db6-9d0c-44c6-995e-0957615c2ee9 req-e39b0056-6fc0-4843-bd85-2b47b6ad276b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:40.858587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-71f68db6-9d0c-44c6-995e-0957615c2ee9 req-e39b0056-6fc0-4843-bd85-2b47b6ad276b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:40.870494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-71f68db6-9d0c-44c6-995e-0957615c2ee9 req-e39b0056-6fc0-4843-bd85-2b47b6ad276b service nova] Creating event network-vif-deleted:13f44c71-4981-48aa-bff5-6222de8d0cc1 for instance e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 on hv-cinder-81644 Dec 24 05:03:40.876000 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-71f68db6-9d0c-44c6-995e-0957615c2ee9 req-e39b0056-6fc0-4843-bd85-2b47b6ad276b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030264 Dec 24 05:03:40.876626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 423/787] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:41.219095 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:41.219685 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:41.226421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:41.226858 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:41.227631 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:41.228046 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:41.298122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:41.306189 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1471 microversion: 2.1 time: 0.090897 Dec 24 05:03:41.306726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 365/788] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:41 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:41.461699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:41.462607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:41.470117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:41.470484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:41.471252 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:41.471678 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:41.607266 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:41.608704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:41.610341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:41.615489 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:41.616081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:41.616933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:41.617367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:41.618519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:41.620788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:41.621962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.166715 Dec 24 05:03:41.622496 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 424/789] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:41 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:41.750087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:41.757406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a44e7f08-de82-4e82-ad50-09d47f972a3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.153947 Dec 24 05:03:41.757971 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 366/790] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:41 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:42.323412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:42.324019 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:42.334468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:42.335688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:42.337126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:42.337584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:42.402155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:42.409855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4152cdb0-2d6f-475c-b875-57036a9de4b2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1471 microversion: 2.1 time: 0.090189 Dec 24 05:03:42.410392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 425/791] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:42 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:42.643528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:42.644326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:42.654175 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:42.654833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:42.655976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:42.656709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:42.773933 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:42.774576 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:42.782489 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:42.782944 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:42.783710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:42.784129 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:42.809590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:42.818052 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:42.819729 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:42.821146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-71ff8111-05dc-491f-bab1-506653ca7e93 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.183471 Dec 24 05:03:42.821676 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 367/792] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:42 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:42.925680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:42.934844 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-28673efb-796d-464d-80f6-3dda980d989c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.164858 Dec 24 05:03:42.935437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 426/793] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:42 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:43.427189 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:43.427791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:43.436977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:43.437535 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:43.438402 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:43.438865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:43.504554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:43.514139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1471 microversion: 2.1 time: 0.090141 Dec 24 05:03:43.515326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 368/794] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:43 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:43.842541 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:43.843272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:43.851850 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:43.852435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:43.853517 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:43.854065 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:43.950947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:43.951544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:43.958234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:43.958671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:43.959409 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:43.959862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:43.998197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:44.006359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:44.007988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:44.009560 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.172444 Dec 24 05:03:44.010236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 427/795] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:43 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:44.112951 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:44.120852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.173500 Dec 24 05:03:44.121425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 369/796] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:43 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:44.531387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:44.532106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:44.538193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:44.538635 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:44.539454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:44.539896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:44.607079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:44.615105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-de279349-9ab6-4e56-a557-56510d36e0b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1471 microversion: 2.1 time: 0.087159 Dec 24 05:03:44.625333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 428/797] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:44 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1471 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:45.034250 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:45.034869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:45.042655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:45.043095 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:45.043860 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:45.044382 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:45.138397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:45.139142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:45.146088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:45.147495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:45.148309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:45.148771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:45.193322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:45.201192 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:45.202643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:45.203785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.173849 Dec 24 05:03:45.204337 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 370/798] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:45 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:45.290788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:45.300369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8c276555-19e5-45e3-a8fa-647020ee5faa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.166503 Dec 24 05:03:45.300975 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 429/799] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:45 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:45.632576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:45.633218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:45.639953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:45.640406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:45.641213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:45.641639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:45.702589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:45.710770 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-799d5898-a724-428e-b941-06c971715a89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1302 microversion: 2.1 time: 0.081851 Dec 24 05:03:45.711332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 371/800] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:45 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:46.222830 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:46.223449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:46.230657 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:46.231104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:46.231876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:46.232303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:46.319502 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:46.319887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:46.326400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:46.326840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:46.327604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:46.328024 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:46.373275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:46.380922 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:46.382372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:46.383500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e0a641e5-7fda-4979-ac5c-e85031e7b32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.164464 Dec 24 05:03:46.384277 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 430/801] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:46 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:46.458032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:46.470257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.156090 Dec 24 05:03:46.470979 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 372/802] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:46 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:46.727033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:46.727631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:46.733793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:46.734234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:46.735009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:46.735417 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:46.799546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:46.807014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-312185c2-b368-4ebf-9385-96a5901071d6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1302 microversion: 2.1 time: 0.083529 Dec 24 05:03:46.807613 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 431/803] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:46 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:47.405889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:47.406835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:47.417611 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:47.418062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:47.418841 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:47.419268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:47.489360 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:47.489922 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:47.496850 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:47.497296 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:47.498084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:47.498511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:47.558096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:47.567036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:47.568588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:47.569822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9ff7ae01-db80-47dc-822d-a50cfdc48560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.170173 Dec 24 05:03:47.570709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 373/804] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:47 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:47.647529 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:47.655688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-834be70e-82da-41d4-b1e2-dd1a754fd39c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1520 microversion: 2.1 time: 0.170000 Dec 24 05:03:47.656277 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 432/805] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:47 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:47.823110 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:47.823818 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:47.830181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:47.830628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:47.831553 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:47.832351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:47.865108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:47.865546 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:47.865988 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'fault' on Instance uuid e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:47.911553 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:47.921904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3835ca68-30e1-41c1-b7a5-2178d233c859 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 200 len: 1307 microversion: 2.1 time: 0.102434 Dec 24 05:03:47.922491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 374/806] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:47 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:48.290000 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-1cd20e96-3631-4691-a2db-178f269c0ca6 req-16823e8c-f57e-46d6-8a0e-79a68a4354af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "name": "network-vif-deleted", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:48.291757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:48.291757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:03:48.299704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1cd20e96-3631-4691-a2db-178f269c0ca6 req-16823e8c-f57e-46d6-8a0e-79a68a4354af service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.300137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1cd20e96-3631-4691-a2db-178f269c0ca6 req-16823e8c-f57e-46d6-8a0e-79a68a4354af service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.315925 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-1cd20e96-3631-4691-a2db-178f269c0ca6 req-16823e8c-f57e-46d6-8a0e-79a68a4354af service nova] Creating event network-vif-deleted:ea61b5c0-ffb7-42bf-9289-095515c125a2 for instance 27408900-d9e8-47e1-be4d-aac80e3f6fae on hv-cinder-81644 Dec 24 05:03:48.323285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-1cd20e96-3631-4691-a2db-178f269c0ca6 req-16823e8c-f57e-46d6-8a0e-79a68a4354af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036874 Dec 24 05:03:48.323882 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 433/807] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:48.590793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:48.591391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:48.601107 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.602009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.603167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.603856 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.673915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:48.674800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:48.682134 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.682665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.683344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.683769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.718585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.719127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.719647 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lazy-loading 'fault' on Instance uuid 27408900-d9e8-47e1-be4d-aac80e3f6fae {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:48.750320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:48.758864 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:48.761625 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:48.762488 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-68508373-528e-4fe2-ac99-09478bf1f9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.177620 Dec 24 05:03:48.767053 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 375/808] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:48 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:48.771640 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa2aab5929e746dbbc011b42927b8e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:48.779648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 200 len: 1311 microversion: 2.1 time: 0.110153 Dec 24 05:03:48.780338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 434/809] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:48 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:48.942779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:48.943922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: e93dfa9e-7d0c-4922-9108-dd3b9c6265e2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:48.955063 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.955844 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.957098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.957758 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:48.976780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] HTTP exception thrown: Instance e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 could not be found. Dec 24 05:03:48.977518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Returning 404 to user: Instance e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:03:48.979068 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a0f75474-60f0-4d28-9bf3-83c491221ad8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2" status: 404 len: 111 microversion: 2.1 time: 0.042377 Dec 24 05:03:48.980129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 376/810] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:48 2021] GET /compute/v2.1/servers/e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:03:48.990796 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:48.991665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:48.998847 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:48.999295 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.000088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:49.000516 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.029196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:03:49.122487 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 204 len: 0 microversion: 2.1 time: 0.135859 Dec 24 05:03:49.123210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 435/811] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:03:48 2021] DELETE /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 24 05:03:49.134046 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:49.134709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:49.143049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:49.143482 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.144248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:49.144749 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.301146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:49.309525 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-30e6aabf-e953-4598-b14b-1427159a8136 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1514 microversion: 2.1 time: 0.180366 Dec 24 05:03:49.313427 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 377/812] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:49 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:49.782520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:49.783193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:49.789904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:49.790341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.791594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:49.791803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.797995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:49.798859 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] [instance: 27408900-d9e8-47e1-be4d-aac80e3f6fae] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:49.805763 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:49.806446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.807720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:49.808504 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:49.823401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] HTTP exception thrown: Instance 27408900-d9e8-47e1-be4d-aac80e3f6fae could not be found. Dec 24 05:03:49.824021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Returning 404 to user: Instance 27408900-d9e8-47e1-be4d-aac80e3f6fae could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:03:49.824873 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bf867147-e7ff-4705-b34b-986770b7231d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae" status: 404 len: 111 microversion: 2.1 time: 0.030917 Dec 24 05:03:49.825415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 378/813] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:49 2021] GET /compute/v2.1/servers/27408900-d9e8-47e1-be4d-aac80e3f6fae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:03:49.940073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:49.949508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:49.951127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:49.952357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.173961 Dec 24 05:03:49.953053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 436/814] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:49 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:50.330815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:50.331624 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:50.339761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:50.340292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:50.341149 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:50.341572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:50.593560 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:50.601531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-12115404-5d46-4d3b-b3bf-afa93dcc65ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1514 microversion: 2.1 time: 0.274770 Dec 24 05:03:50.602139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 379/815] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:50 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:50.972056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:50.973072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:50.980064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:50.980501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:50.981305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:50.981727 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:51.136693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:51.146152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:51.147987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:51.149347 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7717f84e-217e-479e-bbb9-c7d41175209d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.181158 Dec 24 05:03:51.150018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 437/816] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:50 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:51.618230 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:51.618810 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:51.626056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:51.626491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:51.627307 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:51.627731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:51.825508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:51.826122 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:51.832000 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:51.832311 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:51.833116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:51.833533 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:51.927679 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lazy-loading 'services' on Instance uuid e0d6209d-3f4e-4467-bcd3-543f26133bbd {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:51.934118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:51.943057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1514 microversion: 2.1 time: 0.328482 Dec 24 05:03:51.944109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 380/817] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:51 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:52.002472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-adeb5ea0-e364-4739-b128-835d89400847 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd/os-volume_attachments/e58ed276-3e76-4a7c-af94-a92aee3a6a03" status: 202 len: 0 microversion: 2.1 time: 0.180544 Dec 24 05:03:52.003123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 438/818] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:03:51 2021] DELETE /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd/os-volume_attachments/e58ed276-3e76-4a7c-af94-a92aee3a6a03 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:03:52.167933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:52.168703 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:52.175144 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:52.175779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:52.176766 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:52.177629 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:52.340660 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-dfd4f34d-c5eb-4c31-8de4-b4f93c2935ad req-082be369-8d2f-4d4e-94f5-374964a715e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "name": "network-vif-deleted", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:52.342243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:52.342243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:03:52.378078 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-dfd4f34d-c5eb-4c31-8de4-b4f93c2935ad req-082be369-8d2f-4d4e-94f5-374964a715e6 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:52.378965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-dfd4f34d-c5eb-4c31-8de4-b4f93c2935ad req-082be369-8d2f-4d4e-94f5-374964a715e6 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:52.392975 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-dfd4f34d-c5eb-4c31-8de4-b4f93c2935ad req-082be369-8d2f-4d4e-94f5-374964a715e6 service nova] Creating event network-vif-deleted:b0bd939a-1211-4ec1-b074-b2767d087f95 for instance cccacaaf-be31-4169-8a5b-13ea806dbd2c on hv-cinder-81644 Dec 24 05:03:52.399625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-dfd4f34d-c5eb-4c31-8de4-b4f93c2935ad req-082be369-8d2f-4d4e-94f5-374964a715e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064227 Dec 24 05:03:52.402023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 439/819] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:03:52.476167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:52.491199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:52.492852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:52.494252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-138b4816-236b-434a-9fe2-579bed7b049e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.330692 Dec 24 05:03:52.495444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 381/820] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:52 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:52.961502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:52.962199 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:52.968738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:52.969187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:52.969956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:52.970387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:53.011682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:53.012870 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:53.013480 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'fault' on Instance uuid cccacaaf-be31-4169-8a5b-13ea806dbd2c {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:53.060014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:53.075569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dd34e345-ac90-4535-9524-cf633e0f19f8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 200 len: 1307 microversion: 2.1 time: 0.118505 Dec 24 05:03:53.076200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 440/821] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:52 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:53.512628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:53.513328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:53.520686 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:53.521255 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:53.522117 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:53.522553 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:53.692757 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:53.706636 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:53.708172 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:53.709367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.200618 Dec 24 05:03:53.709918 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 382/822] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:53 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:54.092110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:54.092975 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: cccacaaf-be31-4169-8a5b-13ea806dbd2c] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:54.100052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.100762 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.101562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.102144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.115980 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] HTTP exception thrown: Instance cccacaaf-be31-4169-8a5b-13ea806dbd2c could not be found. Dec 24 05:03:54.116594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Returning 404 to user: Instance cccacaaf-be31-4169-8a5b-13ea806dbd2c could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:03:54.117408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5d05e8fc-096e-4ba3-9abe-6b5e265adba6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c" status: 404 len: 111 microversion: 2.1 time: 0.028986 Dec 24 05:03:54.117965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 441/823] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:54 2021] GET /compute/v2.1/servers/cccacaaf-be31-4169-8a5b-13ea806dbd2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:03:54.204265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:54.204782 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:54.215244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.215714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.216477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.216937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.251158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:03:54.328449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0e329549-2024-41a3-aaf2-549df8ae42d0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 204 len: 0 microversion: 2.1 time: 0.128001 Dec 24 05:03:54.329081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 383/824] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:03:54 2021] DELETE /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:03:54.338335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:54.338335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:54.344260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.344652 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.345418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.345877 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.484490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:54.493512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1514 microversion: 2.1 time: 0.160094 Dec 24 05:03:54.494119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 442/825] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:54 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:54.729204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:54.729834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:54.736478 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.736997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.737719 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:54.738149 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:54.878058 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:54.888437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:54.890871 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:54.892904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.167723 Dec 24 05:03:54.904456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 384/826] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:54 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:55.263264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:55.263873 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:55.272051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.272513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:55.273353 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.273778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:55.301104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:03:55.391056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b934c425-5922-4f6e-b8c0-aa9c128af03c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 204 len: 0 microversion: 2.1 time: 0.131724 Dec 24 05:03:55.391885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 443/827] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:03:55 2021] DELETE /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:03:55.399736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:55.400627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:55.406619 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.407056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:55.407819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.408242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:55.511885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:55.512643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:55.522185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.523068 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:55.523862 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.524279 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:55.553743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:55.561764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1515 microversion: 2.1 time: 0.165529 Dec 24 05:03:55.563334 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 385/828] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:55 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:55.668432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:55.677012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0c6394c9-6968-4652-8b56-bc2b742cf69b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1514 microversion: 2.1 time: 0.170363 Dec 24 05:03:55.677573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 444/829] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:55 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:55.910944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:55.911471 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:55.918479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.918955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:55.919729 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:55.920156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:56.057911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:56.067628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:56.069128 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:56.070278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-67a0f85f-faed-465c-9dd8-a0030edd9c5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.163191 Dec 24 05:03:56.070828 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 386/830] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:55 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:56.580047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:56.580605 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:56.588057 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:56.588508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:56.589312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:56.589745 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:56.694903 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:56.695485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:56.703687 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:56.704134 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:56.704956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:56.705391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:56.731815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:56.739090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1515 microversion: 2.1 time: 0.162841 Dec 24 05:03:56.739692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 445/831] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:56 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:56.845745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:56.853041 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6e3565c0-80d1-4064-8137-bd451dcb2fbe tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1514 microversion: 2.1 time: 0.162751 Dec 24 05:03:56.853775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 387/832] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:56 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:03:56.920754 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-62456a1a-d5ab-45e3-9e8a-c68b067a437a req-293fbc55-e061-4e86-b033-4573c3a86aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:56.922373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:56.922373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:03:56.931685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-62456a1a-d5ab-45e3-9e8a-c68b067a437a req-293fbc55-e061-4e86-b033-4573c3a86aac service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:56.932324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-62456a1a-d5ab-45e3-9e8a-c68b067a437a req-293fbc55-e061-4e86-b033-4573c3a86aac service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:56.948206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-62456a1a-d5ab-45e3-9e8a-c68b067a437a req-293fbc55-e061-4e86-b033-4573c3a86aac service nova] Creating event network-vif-plugged:61ec3441-5b75-4c07-b8ad-4174450d6a55 for instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 on hv-cinder-81644 Dec 24 05:03:56.953067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-62456a1a-d5ab-45e3-9e8a-c68b067a437a req-293fbc55-e061-4e86-b033-4573c3a86aac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035873 Dec 24 05:03:56.953598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 446/833] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:57.092588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:57.093704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:57.104119 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.104555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.105370 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.105801 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.314775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:57.323378 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:57.324907 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:57.326091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f30cf3fb-458b-4240-b7fd-7979a742d19a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.239726 Dec 24 05:03:57.326637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 388/834] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:57 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:57.659032 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-e629391c-5bca-4bcc-a696-df2b3aebe056 req-8f909d8f-1179-45db-8123-6d2221693eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "name": "network-vif-deleted", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:57.660616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:57.660616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:03:57.668726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-e629391c-5bca-4bcc-a696-df2b3aebe056 req-8f909d8f-1179-45db-8123-6d2221693eab service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.669161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-e629391c-5bca-4bcc-a696-df2b3aebe056 req-8f909d8f-1179-45db-8123-6d2221693eab service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.679972 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-e629391c-5bca-4bcc-a696-df2b3aebe056 req-8f909d8f-1179-45db-8123-6d2221693eab service nova] Creating event network-vif-deleted:f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 for instance e0d6209d-3f4e-4467-bcd3-543f26133bbd on hv-cinder-81644 Dec 24 05:03:57.684842 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-e629391c-5bca-4bcc-a696-df2b3aebe056 req-8f909d8f-1179-45db-8123-6d2221693eab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030155 Dec 24 05:03:57.685648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 447/835] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:03:57.756267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:57.756982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:57.763146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.763674 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.764476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.764905 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.871679 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:57.872810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:57.884215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.885087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.887045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.887914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.926236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:57.926595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:57.926842 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:57.927621 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lazy-loading 'fault' on Instance uuid e0d6209d-3f4e-4467-bcd3-543f26133bbd {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:03:57.941585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-50f788c7-a068-4556-8a58-8a0c6da563d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1515 microversion: 2.1 time: 0.188917 Dec 24 05:03:57.951467 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 389/836] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:57 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:57.975048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:57.982898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6e23c233-cd46-4e36-9cee-6a8142d496be tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 200 len: 1309 microversion: 2.1 time: 0.116193 Dec 24 05:03:57.983477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 448/837] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:57 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:58.344729 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:58.345325 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:58.351916 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:58.352354 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:58.353138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:58.353827 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:58.497429 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:58.505742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:58.507186 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:58.508319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-94cf1dbc-9c82-4581-b491-620898f2dcfb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.167299 Dec 24 05:03:58.508902 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 390/838] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:58 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:58.958382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:58.958971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:58.966575 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:58.966990 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:58.967773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:58.968197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:59.000555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:59.001403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: e0d6209d-3f4e-4467-bcd3-543f26133bbd] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:59.007636 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:59.008017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:59.008820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:59.009252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:59.023719 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] HTTP exception thrown: Instance e0d6209d-3f4e-4467-bcd3-543f26133bbd could not be found. Dec 24 05:03:59.024367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Returning 404 to user: Instance e0d6209d-3f4e-4467-bcd3-543f26133bbd could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:03:59.025382 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3c33d969-d14a-4033-a5ef-e1cef1db7ce2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd" status: 404 len: 111 microversion: 2.1 time: 0.028692 Dec 24 05:03:59.025870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 391/839] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:58 2021] GET /compute/v2.1/servers/e0d6209d-3f4e-4467-bcd3-543f26133bbd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:03:59.044272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:59.051736 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-88d88514-a5ce-4771-9bf1-8db02d392b92 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1473 microversion: 2.1 time: 0.097086 Dec 24 05:03:59.052306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 449/840] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:03:58 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1473 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:03:59.527078 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:03:59.527692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:03:59.534284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:59.534727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:59.535490 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:59.535914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:59.675388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:59.684021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:59.685547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:03:59.686684 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a203c404-c245-4df0-8347-2f84b8b02ccd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.163468 Dec 24 05:03:59.687226 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 392/841] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:03:59 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:03:59.699045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-edbe40ff-3a05-4a18-8985-a53813c46f72 req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "name": "network-vif-deleted", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:03:59.700589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:59.700589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:03:59.707852 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-edbe40ff-3a05-4a18-8985-a53813c46f72 req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:03:59.708283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-edbe40ff-3a05-4a18-8985-a53813c46f72 req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:03:59.719219 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-edbe40ff-3a05-4a18-8985-a53813c46f72 req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 service nova] Creating event network-vif-deleted:50d50f46-e761-4fb1-9761-fa48778aa8aa for instance 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e on hv-cinder-81644 Dec 24 05:03:59.724219 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-edbe40ff-3a05-4a18-8985-a53813c46f72 req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028692 Dec 24 05:03:59.724795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 450/842] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:04:00.069530 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:00.070262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:00.076932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:00.077377 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:00.078146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:00.078575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:00.108914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:00.109353 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:00.109786 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'fault' on Instance uuid 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:04:00.154411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:00.162243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1308 microversion: 2.1 time: 0.096432 Dec 24 05:04:00.162798 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 393/843] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:00 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:00.711998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:00.713303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:00.724016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:00.724791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:00.726049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:00.726749 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:00.880814 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:00.890002 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:00.891633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:00.893358 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.189775 Dec 24 05:04:00.894120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 451/844] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:00 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:01.182436 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:01.183109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:01.190341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:01.190841 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:01.191727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:01.192201 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:01.224567 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:01.225005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:01.225441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'fault' on Instance uuid 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:04:01.263912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:01.271375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-17a95ebc-cebf-4859-a552-010885d1d9ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1308 microversion: 2.1 time: 0.094806 Dec 24 05:04:01.271970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 394/845] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:01 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:01.920153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:01.920968 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:01.929695 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:01.930278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:01.931297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:01.932095 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:02.074321 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:02.082323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:02.083806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:02.085278 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e905340b-bf83-4c98-8b7c-4a152e99ecfc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.170258 Dec 24 05:04:02.085846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 452/846] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:01 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:02.287084 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:02.287690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:02.294241 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:02.294675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:02.295414 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:02.295922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:02.327336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:02.327771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:02.328200 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lazy-loading 'fault' on Instance uuid 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:04:02.366554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f29f576d3a98449b8077c0df53968f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:02.374272 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-804498f5-d619-462c-ac3f-dabd72a81f26 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 200 len: 1308 microversion: 2.1 time: 0.090950 Dec 24 05:04:02.374835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 395/847] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:02 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:03.103122 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:03.103827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:03.110669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:03.111126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:03.111907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:03.112337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:03.254920 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:03.263334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:03.264829 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:03.265971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1c64eb91-de21-43a6-8d21-7197738c8059 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.166601 Dec 24 05:04:03.266530 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 453/848] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:03 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:03.390100 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:03.390652 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] [instance: 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:03.397705 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:03.398256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:03.398923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:03.399339 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:03.415877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] HTTP exception thrown: Instance 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e could not be found. Dec 24 05:04:03.416451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Returning 404 to user: Instance 7c07c04e-36eb-4aa0-8a33-1c1424a2db2e could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:04:03.417334 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f8f35cc3-4232-4705-9905-dcb9ec3da597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e" status: 404 len: 111 microversion: 2.1 time: 0.030988 Dec 24 05:04:03.417865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 396/849] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:03 2021] GET /compute/v2.1/servers/7c07c04e-36eb-4aa0-8a33-1c1424a2db2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 24 05:04:04.284464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:04.285163 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:04.299885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:04.300322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:04.301177 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:04.301600 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:04.454817 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:04.463123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:04.464610 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:04.465853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-16405f3d-b0ba-436b-a173-19f2d880ba1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.185040 Dec 24 05:04:04.487297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 454/850] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:04 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:05.483239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:05.483713 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:05.490358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:05.490793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:05.491560 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:05.491976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:05.632772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:05.640771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:05.642243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:05.643429 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-75861cc0-48ff-4fea-801b-c5ac337725b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.164113 Dec 24 05:04:05.644082 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 397/851] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:05 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:06.664950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:06.665697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:06.672769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:06.673207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:06.673971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:06.674391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:06.816256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:06.826077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:06.827544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:06.828761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.169569 Dec 24 05:04:06.829300 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 455/852] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:06 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:07.847815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:07.848417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:07.855537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:07.856093 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:07.856894 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:07.857322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:07.993061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:08.001385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:08.002945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:08.004171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7c3a504d-b963-46ff-8383-04885c31b007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.160301 Dec 24 05:04:08.004761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 398/853] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:07 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:09.022195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:09.022869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:09.029160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:09.029443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:09.030214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:09.030643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:09.343149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:09.354413 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:09.356001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:09.357175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-346c0473-fbfb-4523-b644-27fb861f7692 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.338736 Dec 24 05:04:09.357716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 456/854] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:09 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:10.375534 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:10.376182 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:10.383491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:10.383922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:10.384923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:10.385598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:10.687061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:10.694888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:10.696389 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:10.698218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-00bd4fee-216a-44b6-8724-af0c14f1c753 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.326349 Dec 24 05:04:10.698776 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 399/855] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:10 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:11.717038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:11.717730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:11.724981 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:11.725506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:11.726411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:11.726842 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:11.860094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:11.867959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:11.869929 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:11.871084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1742 microversion: 2.20 time: 0.157795 Dec 24 05:04:11.871939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 457/856] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:11 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:12.889725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:12.891295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:12.898381 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:12.899041 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:12.900002 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:12.900788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:13.037480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:13.046378 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:13.047876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:13.049072 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e7016d53-0b1f-4ad5-919f-d65140416832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.163271 Dec 24 05:04:13.049628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 400/857] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:12 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:14.067808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:14.068975 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:14.075989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:14.076784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:14.078137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:14.078718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:14.255288 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:14.266123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:14.270398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:14.271794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f9bc477b-6be9-4f96-97ef-29913817e136 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.208508 Dec 24 05:04:14.283523 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 458/858] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:14 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:15.290963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:15.291809 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:15.299831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:15.300343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:15.301216 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:15.301634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:15.463081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:15.473265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:15.475041 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:15.476450 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-94c99b09-0972-4789-bfe3-218b7e9bf560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.189487 Dec 24 05:04:15.477313 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 401/859] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:15 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:16.494940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:16.495597 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:16.501623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:16.502036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:16.503060 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:16.503543 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:16.643384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:16.651717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:16.653512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:16.655002 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f7e0da25-63a5-47ac-885f-649d6d6a2aea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.164012 Dec 24 05:04:16.655573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 459/860] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:16 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:17.878852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:17.880168 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:17.886887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:17.887667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:17.888990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:17.889699 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:18.030094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:18.043897 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:18.045406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:18.046769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-476613c2-d123-447d-8919-dc0df71c48c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.376609 Dec 24 05:04:18.047326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 402/861] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:17 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:19.066157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:19.067893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:19.074841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:19.075364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:19.076217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:19.076743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:19.227548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:19.235636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:19.237234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:19.238454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-416dc7ff-e525-4fe6-92b1-2b983cdd536c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.176129 Dec 24 05:04:19.239093 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 460/862] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:19 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:20.257261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:20.257853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:20.264360 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:20.264824 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:20.265604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:20.266140 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:20.418111 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:20.426416 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:20.431655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:20.435966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2e7bffca-6725-4f81-9016-69ae62429032 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.182460 Dec 24 05:04:20.446855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 403/863] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:20 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:21.364118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-60785619", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "networks": [{"uuid": "7d6d1704-2ca9-4ba7-a7ef-cd394e15a741"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:04:21.420283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] validate_networks() for [('7d6d1704-2ca9-4ba7-a7ef-cd394e15a741', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:04:21.454303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:21.454880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:21.461932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:21.462738 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:21.464196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:21.465027 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:21.674342 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:21.687710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:21.691528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:21.692755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e3db7120-3ecf-4441-9737-257c1d1b831a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.242050 Dec 24 05:04:21.693322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 404/864] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:21 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:22.140339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:04:22.140775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:04:22.141476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:04:22.142027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:04:22.142571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:04:22.152579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:22.153223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:22.153906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:22.154467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:22.172083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Getting quotas for project 122a6a1d32d648c6938f0b159bb3641c. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:04:22.176794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Getting quotas for user 82fc245c775844e6af2acc79a1e637e8 and project 122a6a1d32d648c6938f0b159bb3641c. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:04:22.188771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:04:22.191118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:04:22.245133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e581ad07-320d-4660-9bba-0a9629c80a9e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884380 Dec 24 05:04:22.246088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 461/865] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:04:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:04:22.256476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-02e965c6-43d1-4d9a-b5d6-7005fa75da81 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:22.258663 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-02e965c6-43d1-4d9a-b5d6-7005fa75da81 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:22.342856 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-02e965c6-43d1-4d9a-b5d6-7005fa75da81 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:22.354209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-02e965c6-43d1-4d9a-b5d6-7005fa75da81 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1217 microversion: 2.1 time: 0.101627 Dec 24 05:04:22.370854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 405/866] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:22 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:22.712297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:22.712936 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:22.720079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:22.720796 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:22.721796 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:22.722206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:22.909874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:22.919384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:22.921178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:22.922541 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0060760b-8dfb-4b33-b9d3-7145c73e31ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.214905 Dec 24 05:04:22.928572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 462/867] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:22 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:23.380811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:23.381585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:23.391751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:23.392291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:23.393625 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:23.394154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:23.466975 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:23.474724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-705c3d12-560b-48ca-b09e-9afff0b48927 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1221 microversion: 2.1 time: 0.099737 Dec 24 05:04:23.475257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 406/868] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:23 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1221 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:23.942879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:23.943567 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:23.951598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:23.952011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:23.952952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:23.953313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:24.084637 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:24.093005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:24.094463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:24.095591 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.158111 Dec 24 05:04:24.096115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 463/869] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:23 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:24.491593 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:24.492198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:24.499163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:24.499603 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:24.500399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:24.500838 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:24.564893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:24.572724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-96d275b1-b8d3-406f-939d-d3fc33358655 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1221 microversion: 2.1 time: 0.084830 Dec 24 05:04:24.573449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 407/870] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:24 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:25.121022 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:25.121734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:25.129564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:25.130099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:25.131020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:25.131532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:25.274632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:25.282749 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:25.284317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:25.285499 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aff297b0-964f-4169-b6af-cd6c3ed2e86f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.170805 Dec 24 05:04:25.286195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 464/871] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:25 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:25.594027 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:25.596169 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:25.603748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:25.604283 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:25.605212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:25.605641 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:25.669897 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:25.681011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-95cadd83-bf62-4a76-a403-50cee3563e2a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1213 microversion: 2.1 time: 0.093385 Dec 24 05:04:25.681856 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 408/872] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:25 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:26.307727 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:26.309021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:26.315961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:26.316403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:26.317230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:26.317656 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:26.456478 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:26.466205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:26.467882 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:26.469229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1581163b-9f6b-43e8-be04-2840d38cb349 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.167477 Dec 24 05:04:26.469874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 465/873] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:26 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:26.698044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:26.699221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:26.706220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:26.706657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:26.707449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:26.707866 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:26.774154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:26.783262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-af961666-8495-4e1f-ae3e-e4cab2338ae5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1213 microversion: 2.1 time: 0.088847 Dec 24 05:04:26.783836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 409/874] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:26 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:27.491679 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:27.492572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:27.501135 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:27.501573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:27.502341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:27.502766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:27.650647 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:27.658800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:27.660251 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:27.661421 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.176259 Dec 24 05:04:27.661953 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 466/875] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:27 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:27.799465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:27.800032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:27.806955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:27.807389 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:27.808155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:27.808563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:27.869800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:27.878028 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1269 microversion: 2.1 time: 0.082406 Dec 24 05:04:27.878591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 410/876] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:27 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:28.683466 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:28.684190 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:28.691500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:28.691947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:28.692834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:28.693257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:28.840328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:28.855446 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:28.860887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:28.870044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1737 microversion: 2.20 time: 0.184772 Dec 24 05:04:28.873108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 467/877] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:28 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:28.894542 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:28.895135 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:28.903854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:28.906252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:28.907069 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:28.907503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:28.989192 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:29.000554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-00c153dc-e53b-4825-8503-c697e69eec20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1275 microversion: 2.1 time: 0.109601 Dec 24 05:04:29.003391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 411/878] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:28 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:29.891690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:29.892331 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:29.899902 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:29.900340 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:29.901131 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:29.901541 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:30.019209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:30.029976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:30.040618 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:30.049995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:30.051805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:30.053055 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1719 microversion: 2.20 time: 0.165716 Dec 24 05:04:30.053798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 468/879] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:29 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:30.065016 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:30.065851 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:30.068369 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:30.068834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:30.138827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-4af5ab5c-56db-4eae-8927-9a070c81569c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:04:30.140501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:04:30.140501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:04:30.149711 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-4af5ab5c-56db-4eae-8927-9a070c81569c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:30.150739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-4af5ab5c-56db-4eae-8927-9a070c81569c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:30.163935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-4af5ab5c-56db-4eae-8927-9a070c81569c service nova] Creating event network-changed:39c2b5d9-53b6-46c0-9a86-f5429051b77c for instance 153cfba1-0ed2-49c8-9da9-c34aa958b46b on hv-cinder-81644 Dec 24 05:04:30.177687 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-4af5ab5c-56db-4eae-8927-9a070c81569c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042655 Dec 24 05:04:30.178559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 469/880] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:04:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:04:30.277628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:30.283199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.267630 Dec 24 05:04:30.283953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 412/881] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:30 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:04:31.073050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:31.073741 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:31.080213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:31.080686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:31.081468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:31.081907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:31.215586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:31.224418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:31.225958 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:31.227276 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1719 microversion: 2.20 time: 0.158864 Dec 24 05:04:31.228281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 470/882] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:31 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:31.300122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:31.301322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:31.308461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:31.308901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:31.309890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:31.310566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:31.462372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:31.471356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-dd8e8345-9813-4560-935f-c0410eb66a0d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.174967 Dec 24 05:04:31.471956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 413/883] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:31 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:32.249350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:32.250049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:32.257670 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:32.258167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:32.259033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:32.259503 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:32.395934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:32.403824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:32.405356 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:32.406444 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-33967d40-70a4-40df-9bad-a131aebea8d2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1719 microversion: 2.20 time: 0.163147 Dec 24 05:04:32.407028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 471/884] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:32 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:32.491995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:32.493321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:32.504192 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:32.504893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:32.506181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:32.506906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:32.639626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-efe55665-89b1-44b2-9700-bd3c827dbf48 req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-unplugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:04:32.642123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:04:32.642123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:04:32.651802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-efe55665-89b1-44b2-9700-bd3c827dbf48 req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:32.652305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-efe55665-89b1-44b2-9700-bd3c827dbf48 req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:32.667648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-efe55665-89b1-44b2-9700-bd3c827dbf48 req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf service nova] Creating event network-vif-unplugged:61ec3441-5b75-4c07-b8ad-4174450d6a55 for instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 on hv-cinder-81644 Dec 24 05:04:32.673904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-efe55665-89b1-44b2-9700-bd3c827dbf48 req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038816 Dec 24 05:04:32.674974 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 472/885] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:04:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:04:32.688146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:32.698585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6ae4a9cb-2268-47f8-878d-be917e51e750 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.212760 Dec 24 05:04:32.699158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 414/886] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:32 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:33.429952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:33.431083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:33.442580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:33.443335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:33.444627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:33.445373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:33.589240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:33.598262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:33.599719 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:33.600939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-00ead7f5-30e7-46d2-a276-3662de6a9903 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1719 microversion: 2.20 time: 0.177932 Dec 24 05:04:33.603269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 473/887] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:33 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:33.719687 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:33.720690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:33.731323 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:33.732134 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:33.733644 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:33.734358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:33.881330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:33.891591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-453099da-cdde-40dc-ac49-aa0b5c1ce28e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.178097 Dec 24 05:04:33.892346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 415/888] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:33 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:34.619179 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:34.619708 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:34.627129 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:34.627568 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:34.628344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:34.628794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:34.766222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:34.774780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:34.776229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:34.777411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2d0951ec-da98-4b34-b73a-1822e96f9543 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1719 microversion: 2.20 time: 0.162023 Dec 24 05:04:34.777948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 474/889] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:34 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:34.917637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:34.918477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:34.925938 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:34.926411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:34.927235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:34.927665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:35.080013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:35.087777 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-af5e9b11-31b2-4fea-a561-b77a1d447547 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.176617 Dec 24 05:04:35.088343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 416/890] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:34 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:35.795319 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:35.795924 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:35.802698 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:35.803140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:35.803908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:35.804330 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:35.936947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:35.944821 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:35.946281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:35.947407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5458c6a5-6b16-4126-80aa-00906e25ebab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1722 microversion: 2.20 time: 0.156018 Dec 24 05:04:35.947982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 475/891] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:35 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:04:35.965509 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6caa4ee3-9134-421f-8afa-ca46c4da0917 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9755e159-97d2-4a13-81e4-6a587dc3452e"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:04:35.966715 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6caa4ee3-9134-421f-8afa-ca46c4da0917 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:35.973292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6caa4ee3-9134-421f-8afa-ca46c4da0917 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:35.973735 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6caa4ee3-9134-421f-8afa-ca46c4da0917 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:35.974539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6caa4ee3-9134-421f-8afa-ca46c4da0917 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:35.974972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6caa4ee3-9134-421f-8afa-ca46c4da0917 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:36.107874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:36.108854 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:36.116195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:36.116670 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:36.117472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:36.118130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:36.277001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:36.283782 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6caa4ee3-9134-421f-8afa-ca46c4da0917 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322040 Dec 24 05:04:36.284898 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 417/892] 10.222.0.43 () {62 vars in 1363 bytes} [Fri Dec 24 05:04:35 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 05:04:36.286474 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-79141ddf-6cfd-4b75-9371-d1c77d580583 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.185108 Dec 24 05:04:36.287063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 476/893] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:36 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:36.395868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2ea3aaa0-baac-4016-8d24-8460398e29f8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:04:36.396551 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2ea3aaa0-baac-4016-8d24-8460398e29f8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:36.404047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ea3aaa0-baac-4016-8d24-8460398e29f8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:36.404662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ea3aaa0-baac-4016-8d24-8460398e29f8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:36.405506 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ea3aaa0-baac-4016-8d24-8460398e29f8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:36.405943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ea3aaa0-baac-4016-8d24-8460398e29f8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:36.543592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2ea3aaa0-baac-4016-8d24-8460398e29f8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action" status: 202 len: 0 microversion: 2.20 time: 0.152354 Dec 24 05:04:36.544200 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 418/894] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:04:36 2021] POST /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:04:36.552306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:36.552986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:36.559650 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:36.560313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:36.561261 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:36.561803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:36.703555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:36.712168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:36.713648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:36.714778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f48a2728-2725-45db-817e-4881c763988a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1748 microversion: 2.20 time: 0.166277 Dec 24 05:04:36.715332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 477/895] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:36 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:37.304022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:37.305648 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:37.316351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:37.321400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:37.323520 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:37.323963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:37.475792 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:37.483677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.184036 Dec 24 05:04:37.484254 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 419/896] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:37 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:04:37.735613 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:37.736942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:37.743367 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:37.744043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:37.744885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:37.745320 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:37.925153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:37.951457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:37.954792 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:37.955375 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1748 microversion: 2.20 time: 0.225278 Dec 24 05:04:37.965739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 478/897] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:37 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1748 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:38.503694 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:38.504498 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:38.513991 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:38.514473 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:38.515243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:38.515669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:38.651379 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:38.659207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-090a56be-22b3-48d1-a408-9e53c9d5a58d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.161010 Dec 24 05:04:38.659770 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 420/898] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:38 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:38.976251 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:38.976926 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:38.986156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:38.987001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:38.988699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:38.989416 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:39.136971 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:39.151833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:39.153357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:39.154944 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cbea22d7-f644-4c40-a02e-0d938a5a0197 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1748 microversion: 2.20 time: 0.183554 Dec 24 05:04:39.155497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 479/899] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:38 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1748 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:39.675705 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:39.676323 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:39.684801 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:39.685494 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:39.686325 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:39.686753 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:39.825160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:39.832749 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-22060656-7337-4293-9164-b324dd9cdb6b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.161024 Dec 24 05:04:39.833315 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 421/900] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:39 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:40.173002 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:40.174144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:40.180615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:40.181136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:40.181984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:40.182462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:40.313388 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:40.322837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:40.324458 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:40.325692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1748 microversion: 2.20 time: 0.156547 Dec 24 05:04:40.326502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 480/901] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:40 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:40.849911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:40.850521 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:40.857223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:40.857688 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:40.858562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:40.858992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:41.009227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:41.021059 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.174755 Dec 24 05:04:41.021672 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 422/902] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:40 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:04:41.344864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:41.345471 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:41.352175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:41.352648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:41.353428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:41.353856 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:41.491600 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:41.500180 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:41.501699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:41.502835 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-704004cd-b31c-4fa4-a242-df0247ba39ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1748 microversion: 2.20 time: 0.162021 Dec 24 05:04:41.503394 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 481/903] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:41 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:42.037424 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:42.038047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:42.044721 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:42.045172 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:42.045979 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:42.046479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:42.178714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:42.186711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-df1397ff-ea1a-4440-8423-ddececbe9cb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.152974 Dec 24 05:04:42.187269 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 423/904] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:42 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:42.525054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:42.525884 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:42.535956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:42.536404 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:42.537264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:42.537701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:42.678912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:42.687495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:42.689034 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:42.690169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-77d1af07-99ad-41c7-b82b-affcfea62600 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1750 microversion: 2.20 time: 0.171696 Dec 24 05:04:42.690711 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 482/905] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:42 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:04:43.207349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:43.208388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:43.219112 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:43.219667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:43.220587 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:43.221012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:43.373492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:43.381315 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-72a7974a-5766-4fee-8d58-4bcb225c3f95 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.180346 Dec 24 05:04:43.381957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 424/906] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:43 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:43.715556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:43.716185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:43.722873 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:43.723331 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:43.724083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:43.724508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:43.865501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:43.875088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:43.877114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:43.878262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1750 microversion: 2.20 time: 0.166604 Dec 24 05:04:43.878823 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 483/907] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:43 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:44.045152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-fb01515c-271c-44d4-93ff-3aefacbb3997 req-7e72da18-b477-4e7b-815b-5ef3a1cf681a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "name": "network-vif-plugged", "status": "completed", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:04:44.046768 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:04:44.046768 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:04:44.054124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-fb01515c-271c-44d4-93ff-3aefacbb3997 req-7e72da18-b477-4e7b-815b-5ef3a1cf681a service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:44.055048 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-fb01515c-271c-44d4-93ff-3aefacbb3997 req-7e72da18-b477-4e7b-815b-5ef3a1cf681a service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:44.076198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-fb01515c-271c-44d4-93ff-3aefacbb3997 req-7e72da18-b477-4e7b-815b-5ef3a1cf681a service nova] Creating event network-vif-plugged:39c2b5d9-53b6-46c0-9a86-f5429051b77c for instance 153cfba1-0ed2-49c8-9da9-c34aa958b46b on hv-cinder-81644 Dec 24 05:04:44.082931 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-fb01515c-271c-44d4-93ff-3aefacbb3997 req-7e72da18-b477-4e7b-815b-5ef3a1cf681a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041867 Dec 24 05:04:44.083530 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 425/908] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:04:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:04:44.398775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:44.399453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:44.406161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:44.406853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:44.407908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:44.408959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:44.562589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:44.570592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.176047 Dec 24 05:04:44.572579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 484/909] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:44 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:44.898318 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:44.899007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:44.918993 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:44.919674 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:44.920713 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:44.921333 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:45.161397 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:45.171811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:45.173512 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:45.175193 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d2154a0a-3186-412e-9306-39b256b1fd28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.281826 Dec 24 05:04:45.175987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 426/910] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:44 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:45.587154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:45.587777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:45.594006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:45.594658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:45.595625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:45.596228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:45.751379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:45.762820 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1317 microversion: 2.1 time: 0.179146 Dec 24 05:04:45.773338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 485/911] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:45 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:46.194577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:46.195737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:46.203759 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:46.204324 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:46.205451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:46.206064 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:46.410617 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:46.425474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:46.428131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:46.429721 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.238899 Dec 24 05:04:46.430457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 427/912] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:46 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:46.779913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:46.781193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:46.788772 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:46.789183 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:46.790295 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:46.790891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:46.958734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:46.976563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1506 microversion: 2.1 time: 0.200076 Dec 24 05:04:46.977774 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 486/913] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:04:46 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:04:46.993832 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0d79121e-e4ea-4435-8b60-2511ccd3d003 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5a1edea-62ce-4cf9-8cda-8ebe87e0acd7", "device": "/dev/sdb"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:04:46.994962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0d79121e-e4ea-4435-8b60-2511ccd3d003 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:47.006037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d79121e-e4ea-4435-8b60-2511ccd3d003 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:47.006552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d79121e-e4ea-4435-8b60-2511ccd3d003 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:47.011515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d79121e-e4ea-4435-8b60-2511ccd3d003 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:47.012035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d79121e-e4ea-4435-8b60-2511ccd3d003 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:47.452416 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:47.453173 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:47.461713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:47.466436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:47.468317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:47.469006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:47.637419 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:47.646141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:47.647791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:47.649074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.200484 Dec 24 05:04:47.649626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 487/914] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:47 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:48.669154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:48.669839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:48.676341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:48.677033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:48.678031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:48.678800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:48.898841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:48.909512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:48.911322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:48.912777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.248058 Dec 24 05:04:48.913900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 488/915] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:48 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:04:49.938339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:49.939100 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:49.952513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:49.954994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:49.957322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:49.959965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:50.266366 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:50.284014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:50.290986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:50.293807 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-79e93e45-62ff-4039-9b5b-2af473726bb7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.359713 Dec 24 05:04:50.296078 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 489/916] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:49 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:51.315059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:51.315865 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:51.322669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:51.323107 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:51.324025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:51.324441 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:51.507662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:51.521222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:51.523119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:51.524282 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.213630 Dec 24 05:04:51.524897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 490/917] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:51 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:52.545783 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:52.546450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:52.553653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:52.554428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:52.555284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:52.555788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:52.719048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:52.741154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:52.743086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:52.744464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f396bf8e-fa05-4804-bf62-62ced5951dc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.203352 Dec 24 05:04:52.745588 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 491/918] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:52 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:04:53.763905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:53.765532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:53.772456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:53.772923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:53.773704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:53.774196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:53.970626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:53.980086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:53.981707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:53.983376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-661453f5-523c-45c2-9f94-6ec19fd9cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.223629 Dec 24 05:04:53.984505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 492/919] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:53 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:04:55.002151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:55.002934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:55.009299 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:55.009731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:55.010545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:55.010974 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:55.162204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:55.170283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:55.171746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:55.172918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.174955 Dec 24 05:04:55.173486 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 493/920] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:54 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:56.191621 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:56.192475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:56.199610 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:56.200054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:56.201063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:56.201492 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:56.355570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:56.363813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:56.365308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:56.366479 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.179005 Dec 24 05:04:56.367028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 494/921] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:56 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:04:57.385646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:57.386444 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:57.393636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:57.394157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:57.395220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:57.396099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:57.536940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:57.545206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:57.546656 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:57.547786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-089a8405-e424-48b2-9a33-161dae5ac37e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.166374 Dec 24 05:04:57.548347 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 495/922] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:57 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:04:58.566427 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:58.567171 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:58.574765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:58.575207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:58.577763 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:58.578351 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:58.724955 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:58.733926 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:58.735385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:58.736556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4e287637-3f13-4247-a323-92e68ba8e6ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.174698 Dec 24 05:04:58.737243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 496/923] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:58 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:04:59.757104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:04:59.757798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:04:59.764561 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:59.765424 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:59.766232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:04:59.766629 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:04:59.925136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:59.933495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:59.934976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:04:59.936120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2d0d6237-4c41-4520-a311-9cd5d2e65963 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.183431 Dec 24 05:04:59.936706 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 497/924] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:04:59 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:05:00.955491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:00.956471 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:00.963642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:00.964105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:00.964962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:00.965391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:01.118562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:01.127359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:01.129238 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:01.130384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1b155405-9f12-4743-9244-11d44e5696f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.178949 Dec 24 05:05:01.130965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 498/925] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:00 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:02.148177 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:02.148931 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:02.155458 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:02.155897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:02.156685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:02.157109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:02.293989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:02.302942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:02.304400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:02.305572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.161175 Dec 24 05:05:02.306125 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 499/926] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:02 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:05:02.626973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0d79121e-e4ea-4435-8b60-2511ccd3d003 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "POST /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.636694 Dec 24 05:05:02.627585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 428/927] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:04:46 2021] POST /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b/os-volume_attachments => generated 194 bytes in 15638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:05:03.323456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:03.324162 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:03.330509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:03.330941 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:03.331696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:03.332117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:03.470204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:03.479367 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:03.481046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:03.482245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.162706 Dec 24 05:05:03.482939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 500/928] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:03 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:05:04.501456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:04.502141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:04.509097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:04.509540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:04.510313 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:04.510748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:04.655017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:04.663759 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:04.665429 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:04.666595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-330af937-82fa-4030-860f-87603354e8e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.169811 Dec 24 05:05:04.667138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 429/929] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:04 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:05.685307 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:05.685956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:05.693043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:05.693500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:05.694257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:05.694683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:05.833735 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:05.850774 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:05.852443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:05.853687 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ec12e7ff-4d20-4207-91e7-6770f6446483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.172502 Dec 24 05:05:05.854267 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 501/930] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:05 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:06.871982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:06.872835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:06.880909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:06.881524 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:06.882475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:06.883020 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:07.020649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:07.029677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:07.031381 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:07.032771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5c7ff225-1e15-4a3a-b721-cb8395397e8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.165091 Dec 24 05:05:07.034463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 430/931] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:06 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:08.051316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:08.051921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:08.058724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:08.059161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:08.059919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:08.060342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:08.191646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:08.201205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:08.202773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:08.203914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.156347 Dec 24 05:05:08.204443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 502/932] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:08 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:09.222970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:09.223642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:09.230912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:09.231286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:09.232062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:09.232482 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:09.366032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:09.375780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:09.377340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:09.378504 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7d112a27-b477-4fab-b7f5-3322ef224772 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.159717 Dec 24 05:05:09.379062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 431/933] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:09 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:10.397140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:10.398383 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:10.405431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:10.405887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:10.406667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:10.407090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:10.550816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:10.559046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:10.560511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:10.561666 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-66145f81-f854-41c1-aa54-f20a824758a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.168485 Dec 24 05:05:10.562221 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 503/934] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:10 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:11.581320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:11.584137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:11.597957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:11.598401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:11.599357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:11.600093 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:11.739650 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:11.748456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:11.749733 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:11.751336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.173712 Dec 24 05:05:11.751882 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 432/935] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:11 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:12.769642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:12.770252 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:12.777412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:12.777940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:12.778557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:12.778985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:12.917063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:12.926898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:12.928371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:12.929724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a46f74b1-9c6b-4b00-a027-53129943301e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.163893 Dec 24 05:05:12.930279 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 504/936] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:12 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:05:13.950236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:13.950975 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:13.958387 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:13.958794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:13.959676 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:13.960032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:14.108984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:14.123515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:14.125956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:14.127769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-89a1a581-329c-48ae-9a15-5770af83bfe4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.182300 Dec 24 05:05:14.128650 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 433/937] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:13 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:15.147114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:15.147671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:15.154160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:15.154607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:15.155374 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:15.155802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:15.305098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:15.314314 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:15.315775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:15.316942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.173654 Dec 24 05:05:15.317500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 505/938] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:15 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:16.337796 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:16.338393 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:16.348121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:16.348833 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:16.349986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:16.350571 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:16.492384 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:16.502597 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:16.504174 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:16.505390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.173652 Dec 24 05:05:16.505957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 434/939] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:16 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:17.526536 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:17.527166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:17.534455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:17.534934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:17.535774 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:17.536258 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:17.673390 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:17.682012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:17.683471 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:17.684629 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bbcb3ce0-823e-4553-8a53-12553f40c051 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.163968 Dec 24 05:05:17.685218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 506/940] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:17 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:18.705725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:18.706711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:18.718644 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:18.719350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:18.720606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:18.721365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:18.877385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:18.886355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:18.887814 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:18.888982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3a4128ee-42b6-489d-959d-af9350802072 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.189359 Dec 24 05:05:18.889538 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 435/941] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:18 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:19.908049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:19.908631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:19.915426 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:19.915866 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:19.916655 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:19.917072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:20.057446 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:20.066340 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:20.067799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:20.068972 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-05f413a4-8da4-4908-9feb-7553dc2c5a14 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.164669 Dec 24 05:05:20.069521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 507/942] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:19 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:21.087422 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:21.088114 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:21.094416 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:21.094862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:21.095633 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:21.096062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:21.229885 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:21.238219 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:21.239702 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:21.240965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-669b029e-c634-4aed-84af-6fd7bdb79322 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.157477 Dec 24 05:05:21.241525 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 436/943] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:21 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:22.261412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:22.262350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:22.270520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:22.271047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:22.271913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:22.272390 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:22.411739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:22.420571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:22.422039 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:22.423184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a691464a-a130-4d5e-963b-b13be993bfa3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.166983 Dec 24 05:05:22.423738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 508/944] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:22 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:23.441719 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:23.442291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:23.449015 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:23.449444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:23.450214 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:23.450640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:23.583999 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:23.593147 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:23.594676 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:23.595874 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.157938 Dec 24 05:05:23.596446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 437/945] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:23 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:24.621769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:24.622467 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:24.628933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:24.629454 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:24.630424 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:24.631000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:24.712284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-16b8820d-20f9-4e43-ba38-5aa449ce473f req-64af7c91-5e23-4e05-9ca6-963bd33c872c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:05:24.714111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:24.714111 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:05:24.721149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-16b8820d-20f9-4e43-ba38-5aa449ce473f req-64af7c91-5e23-4e05-9ca6-963bd33c872c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:24.721581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-16b8820d-20f9-4e43-ba38-5aa449ce473f req-64af7c91-5e23-4e05-9ca6-963bd33c872c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:24.734481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-16b8820d-20f9-4e43-ba38-5aa449ce473f req-64af7c91-5e23-4e05-9ca6-963bd33c872c service nova] Creating event network-vif-plugged:61ec3441-5b75-4c07-b8ad-4174450d6a55 for instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 on hv-cinder-81644 Dec 24 05:05:24.740435 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-16b8820d-20f9-4e43-ba38-5aa449ce473f req-64af7c91-5e23-4e05-9ca6-963bd33c872c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157198 Dec 24 05:05:24.741456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 509/946] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:05:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:05:24.775153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:24.783625 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:24.785117 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:24.786251 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2711533d-84eb-4cbf-b583-4ba9b0945c66 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.168231 Dec 24 05:05:24.786799 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 438/947] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:24 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:05:25.805757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:25.806475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:25.813415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:25.813846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:25.814609 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:25.815031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:25.956766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:25.965725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:25.967192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:25.968320 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.166714 Dec 24 05:05:25.968900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 510/948] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:25 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:26.991000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:26.991745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:27.001822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:27.002435 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:27.003639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:27.004123 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:27.115316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:27.115906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:27.122632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:27.123083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:27.123875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:27.124281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:27.142109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:27.155372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:27.157229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:27.158249 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e34eb0f3-b069-4869-a7e7-226532246d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1806 microversion: 2.20 time: 0.173392 Dec 24 05:05:27.158967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 439/949] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:26 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:27.208654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lazy-loading 'services' on Instance uuid 153cfba1-0ed2-49c8-9da9-c34aa958b46b {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:05:27.294006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3b3de1c8-6d79-49a2-a8a3-c35cdb35743c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "DELETE /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b/os-volume_attachments/b5a1edea-62ce-4cf9-8cda-8ebe87e0acd7" status: 202 len: 0 microversion: 2.1 time: 0.182002 Dec 24 05:05:27.295062 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 511/950] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:05:27 2021] DELETE /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b/os-volume_attachments/b5a1edea-62ce-4cf9-8cda-8ebe87e0acd7 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:05:28.183892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:28.185039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:28.191581 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:28.192025 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:28.192834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:28.193262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:28.343997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:28.352320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:28.353911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:28.355177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-76194800-3c3b-4e45-bbd8-63a8efbd5689 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1793 microversion: 2.20 time: 0.177454 Dec 24 05:05:28.355822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 440/951] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:05:28 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1793 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:05:28.410126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:28.410704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:28.417117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:28.417558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:28.418329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:28.418750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:28.445982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:05:28.531434 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a36f5c99-9b3b-4fde-863b-f74303420054 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "DELETE /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 204 len: 0 microversion: 2.1 time: 0.126180 Dec 24 05:05:28.532009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 512/952] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:05:28 2021] DELETE /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:05:28.540681 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:28.541295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:28.548044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:28.548489 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:28.549312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:28.549741 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:28.686392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:28.693977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-de3191ab-4f58-49fc-a993-6600ad24fcda tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1512 microversion: 2.1 time: 0.157164 Dec 24 05:05:28.694539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 441/953] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:05:28 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:05:29.717232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:29.717938 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:29.726008 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:29.726453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:29.727407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:29.727894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:29.867697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:29.875616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-16966163-e8eb-4caf-85a7-c45f63ccc59c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1512 microversion: 2.1 time: 0.167072 Dec 24 05:05:29.876178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 513/954] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:05:29 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:05:30.893050 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:30.893794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:30.901534 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:30.901997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:30.903007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:30.903452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:31.122931 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc245c775844e6af2acc79a1e637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122a6a1d32d648c6938f0b159bb3641c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:05:31.131150 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-47982791-9c55-4a62-b711-89d280cd4fb7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 200 len: 1512 microversion: 2.1 time: 0.241769 Dec 24 05:05:31.131698 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 442/955] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:05:30 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:05:31.288636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-65095dcf-65a8-4760-9895-88554969a51c req-8e36a34a-d866-4bd6-b5d2-79cf171a716b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "name": "network-vif-deleted", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:05:31.290329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:31.290329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:05:31.298501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-65095dcf-65a8-4760-9895-88554969a51c req-8e36a34a-d866-4bd6-b5d2-79cf171a716b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:31.298984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-65095dcf-65a8-4760-9895-88554969a51c req-8e36a34a-d866-4bd6-b5d2-79cf171a716b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:31.311184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-65095dcf-65a8-4760-9895-88554969a51c req-8e36a34a-d866-4bd6-b5d2-79cf171a716b service nova] Creating event network-vif-deleted:39c2b5d9-53b6-46c0-9a86-f5429051b77c for instance 153cfba1-0ed2-49c8-9da9-c34aa958b46b on hv-cinder-81644 Dec 24 05:05:31.316850 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-65095dcf-65a8-4760-9895-88554969a51c req-8e36a34a-d866-4bd6-b5d2-79cf171a716b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092273 Dec 24 05:05:31.317481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 514/956] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:05:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:05:32.151741 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:05:32.152677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] [instance: 153cfba1-0ed2-49c8-9da9-c34aa958b46b] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:05:32.163376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:32.164068 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:32.165343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:05:32.166035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:05:32.181318 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] HTTP exception thrown: Instance 153cfba1-0ed2-49c8-9da9-c34aa958b46b could not be found. Dec 24 05:05:32.181887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Returning 404 to user: Instance 153cfba1-0ed2-49c8-9da9-c34aa958b46b could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:05:32.182704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0e88dae4-2763-4765-885b-bf59e39277ec tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b" status: 404 len: 111 microversion: 2.1 time: 0.037104 Dec 24 05:05:32.183225 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 443/957] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:05:32 2021] GET /compute/v2.1/servers/153cfba1-0ed2-49c8-9da9-c34aa958b46b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:05:57.561721 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:05:57.562782 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:05:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:06:21.875770 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0306eb29-1102-49f9-9172-e0b99b337cd4 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Action: 'create', calling method: .version_select at 0x7f7bb2dc61f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1181792733"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:21.897599 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-0306eb29-1102-49f9-9172-e0b99b337cd4 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Getting quotas for project f081e71a66b74c3bb12e1bec9d9a5cd1. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:21.902120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-0306eb29-1102-49f9-9172-e0b99b337cd4 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Getting quotas for user 8bd940f9211f415987d3443601acabc4 and project f081e71a66b74c3bb12e1bec9d9a5cd1. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:22.208861 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-0306eb29-1102-49f9-9172-e0b99b337cd4 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Getting quotas for project f081e71a66b74c3bb12e1bec9d9a5cd1. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:22.221986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-0306eb29-1102-49f9-9172-e0b99b337cd4 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Getting quotas for user 8bd940f9211f415987d3443601acabc4 and project f081e71a66b74c3bb12e1bec9d9a5cd1. Resources: {'key_pairs'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:22.237366 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0306eb29-1102-49f9-9172-e0b99b337cd4 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.365536 Dec 24 05:06:22.249356 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 515/958] 10.222.0.43 () {60 vars in 1157 bytes} [Fri Dec 24 05:06:21 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:22.360686 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1369656600", "imageRef": "8d6f73b1-939f-4e5f-9881-67cc9aeb649c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1181792733", "networks": [{"uuid": "f6c8eead-66df-4cba-abce-78ee3b037ee2"}]}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:22.425884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] validate_networks() for [('f6c8eead-66df-4cba-abce-78ee3b037ee2', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:06:23.405556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:06:23.406089 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:06:23.406303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:06:23.406914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:06:23.407867 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:06:23.419507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:23.419954 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:23.420950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:23.421564 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:23.446320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Getting quotas for project f081e71a66b74c3bb12e1bec9d9a5cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:23.450683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Getting quotas for user 8bd940f9211f415987d3443601acabc4 and project f081e71a66b74c3bb12e1bec9d9a5cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:23.462513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:06:23.465348 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d6f73b1-939f-4e5f-9881-67cc9aeb649c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:06:23.516422 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d85db859-57a9-41f6-ae51-0b6ca99dba17 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159925 Dec 24 05:06:23.517164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 444/959] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:06:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 24 05:06:23.527877 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eaa30d52-c6b0-4c04-8db1-d921737ce1d6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:23.528626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eaa30d52-c6b0-4c04-8db1-d921737ce1d6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:23.609012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eaa30d52-c6b0-4c04-8db1-d921737ce1d6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:23.618470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eaa30d52-c6b0-4c04-8db1-d921737ce1d6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1259 microversion: 2.1 time: 0.094473 Dec 24 05:06:23.621633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 516/960] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:23 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1259 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:24.635153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:24.635852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:24.643450 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:24.643912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:24.644828 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:24.645447 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:24.751902 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:24.762711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-62b36733-60eb-476c-87b0-6aa060319ed5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1319 microversion: 2.1 time: 0.131157 Dec 24 05:06:24.764340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 445/961] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:24 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1319 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:06:25.780308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:25.782097 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:25.806780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:25.808504 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:25.813059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:25.813791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:25.938725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:25.953597 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1317 microversion: 2.1 time: 0.176867 Dec 24 05:06:25.957155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 517/962] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:25 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:26.973812 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:26.975285 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:26.987923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:26.988745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:26.990212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:26.990670 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:27.338570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:27.351018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.381177 Dec 24 05:06:27.354746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 446/963] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:26 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:28.370980 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:28.371592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:28.379785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:28.385090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:28.386198 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:28.386889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:28.589800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:28.611588 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.244440 Dec 24 05:06:28.613986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 518/964] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:28 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:28.804827 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-93d6c246-7e1b-467a-81f9-a3e5ae485ba3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:28.806167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-93d6c246-7e1b-467a-81f9-a3e5ae485ba3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:28.827736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93d6c246-7e1b-467a-81f9-a3e5ae485ba3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:28.833366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93d6c246-7e1b-467a-81f9-a3e5ae485ba3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:28.837136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93d6c246-7e1b-467a-81f9-a3e5ae485ba3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:28.837755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93d6c246-7e1b-467a-81f9-a3e5ae485ba3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:28.900697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-93d6c246-7e1b-467a-81f9-a3e5ae485ba3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments/9755e159-97d2-4a13-81e4-6a587dc3452e" status: 200 len: 194 microversion: 2.20 time: 0.100162 Dec 24 05:06:28.903359 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 447/965] 10.222.0.43 () {60 vars in 1453 bytes} [Fri Dec 24 05:06:28 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments/9755e159-97d2-4a13-81e4-6a587dc3452e => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:29.035764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:29.036518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:29.047893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:29.049901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:29.053013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:29.053647 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:29.221502 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lazy-loading 'services' on Instance uuid 6485c286-d5e3-42e7-bf58-c4685f8c3066 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:06:29.324260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e3c90e9c-a3d9-4e49-9a2b-6cc6dbf2b1c5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments/9755e159-97d2-4a13-81e4-6a587dc3452e" status: 202 len: 0 microversion: 2.20 time: 0.291227 Dec 24 05:06:29.325012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 519/966] 10.222.0.43 () {60 vars in 1456 bytes} [Fri Dec 24 05:06:29 2021] DELETE /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments/9755e159-97d2-4a13-81e4-6a587dc3452e => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:06:29.336805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f564d479-c8a5-4bb7-8424-7ab8a8f3383a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:29.337786 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f564d479-c8a5-4bb7-8424-7ab8a8f3383a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:29.347814 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f564d479-c8a5-4bb7-8424-7ab8a8f3383a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:29.348724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f564d479-c8a5-4bb7-8424-7ab8a8f3383a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:29.349531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f564d479-c8a5-4bb7-8424-7ab8a8f3383a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:29.350304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f564d479-c8a5-4bb7-8424-7ab8a8f3383a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:29.404816 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f564d479-c8a5-4bb7-8424-7ab8a8f3383a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074503 Dec 24 05:06:29.405673 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 448/967] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:29 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:29.631201 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:29.632617 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:29.639005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:29.639754 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:29.640777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:29.641507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:29.874631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:29.882462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.255602 Dec 24 05:06:29.891992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 520/968] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:29 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:30.417519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1331afcc-361d-42a3-b331-475239ae6341 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:30.418914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1331afcc-361d-42a3-b331-475239ae6341 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:30.433801 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1331afcc-361d-42a3-b331-475239ae6341 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:30.435758 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1331afcc-361d-42a3-b331-475239ae6341 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:30.436601 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1331afcc-361d-42a3-b331-475239ae6341 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:30.437047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1331afcc-361d-42a3-b331-475239ae6341 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:30.515072 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1331afcc-361d-42a3-b331-475239ae6341 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101105 Dec 24 05:06:30.524641 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 449/969] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:30 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:30.899586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:30.900332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:30.906998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:30.907811 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:30.908958 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:30.909589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:31.073715 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:31.081738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9deba91c-e4c8-485e-a234-b76a0bec4303 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.185656 Dec 24 05:06:31.083862 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 521/970] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:30 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:31.356461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-29b7d191-2ee9-49fb-94fb-d6591a3baf19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Action: 'create', calling method: .version_select at 0x7f7badf2e4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1364510469"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:31.388152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-29b7d191-2ee9-49fb-94fb-d6591a3baf19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:31.392248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-29b7d191-2ee9-49fb-94fb-d6591a3baf19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for user 4039d5c6890448ee99194d769c5c387b and project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:31.532881 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e8341337-a186-4dcc-962a-644d4dfd734f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:31.535144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e8341337-a186-4dcc-962a-644d4dfd734f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:31.542554 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8341337-a186-4dcc-962a-644d4dfd734f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:31.543269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8341337-a186-4dcc-962a-644d4dfd734f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:31.544294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8341337-a186-4dcc-962a-644d4dfd734f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:31.544934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8341337-a186-4dcc-962a-644d4dfd734f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:31.583855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e8341337-a186-4dcc-962a-644d4dfd734f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056685 Dec 24 05:06:31.585074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 522/971] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:31 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 05:06:31.883408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-29b7d191-2ee9-49fb-94fb-d6591a3baf19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:31.888477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-29b7d191-2ee9-49fb-94fb-d6591a3baf19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for user 4039d5c6890448ee99194d769c5c387b and project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:31.903287 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-29b7d191-2ee9-49fb-94fb-d6591a3baf19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.764108 Dec 24 05:06:31.904370 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 450/972] 10.222.0.43 () {60 vars in 1157 bytes} [Fri Dec 24 05:06:31 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:32.100752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:32.102058 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:32.111217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:32.114967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:32.116768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:32.117390 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:32.555424 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:32.559046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4f4a6271-b70d-4e83-a6a5-01497115fe98 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.460728 Dec 24 05:06:32.559046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 523/973] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:32 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:32.599185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9c6a5565-48fd-44f6-bf2b-3c27fea46833 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:32.600754 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9c6a5565-48fd-44f6-bf2b-3c27fea46833 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:32.609097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9c6a5565-48fd-44f6-bf2b-3c27fea46833 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:32.610778 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9c6a5565-48fd-44f6-bf2b-3c27fea46833 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:32.612513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9c6a5565-48fd-44f6-bf2b-3c27fea46833 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:32.613105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9c6a5565-48fd-44f6-bf2b-3c27fea46833 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:32.660882 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9c6a5565-48fd-44f6-bf2b-3c27fea46833 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068434 Dec 24 05:06:32.665082 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 451/974] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:32 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:33.575586 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:33.576288 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:33.584140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:33.584688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:33.585808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:33.586419 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:33.672390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-acb73861-153e-43a5-8051-5e1c2b7d056e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:33.673212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-acb73861-153e-43a5-8051-5e1c2b7d056e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:33.679436 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acb73861-153e-43a5-8051-5e1c2b7d056e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:33.679884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acb73861-153e-43a5-8051-5e1c2b7d056e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:33.680825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acb73861-153e-43a5-8051-5e1c2b7d056e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:33.681258 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-acb73861-153e-43a5-8051-5e1c2b7d056e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:33.724329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-acb73861-153e-43a5-8051-5e1c2b7d056e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055977 Dec 24 05:06:33.728380 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 452/975] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:33 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 05:06:33.751030 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:33.769761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.198238 Dec 24 05:06:33.772836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 524/976] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:33 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:34.735920 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7d3798c6-020d-4218-a19c-e9885c8c5087 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:34.736950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7d3798c6-020d-4218-a19c-e9885c8c5087 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:34.743989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d3798c6-020d-4218-a19c-e9885c8c5087 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:34.744427 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d3798c6-020d-4218-a19c-e9885c8c5087 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:34.745246 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d3798c6-020d-4218-a19c-e9885c8c5087 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:34.745665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d3798c6-020d-4218-a19c-e9885c8c5087 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:34.782216 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7d3798c6-020d-4218-a19c-e9885c8c5087 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049999 Dec 24 05:06:34.783482 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 453/977] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:34 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:34.788860 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:34.789532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:34.797901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:34.798827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:34.799993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:34.800730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:34.943115 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:34.957960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-693a4652-8cab-4abc-b166-0b8b05c22fca tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.171140 Dec 24 05:06:34.959243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 525/978] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:34 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:35.795132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8bcdc78a-68ae-492c-a90e-d1ee1c453250 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:35.796208 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8bcdc78a-68ae-492c-a90e-d1ee1c453250 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:35.804502 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcdc78a-68ae-492c-a90e-d1ee1c453250 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:35.805562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcdc78a-68ae-492c-a90e-d1ee1c453250 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:35.807475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcdc78a-68ae-492c-a90e-d1ee1c453250 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:35.808082 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8bcdc78a-68ae-492c-a90e-d1ee1c453250 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:35.845900 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8bcdc78a-68ae-492c-a90e-d1ee1c453250 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055263 Dec 24 05:06:35.846829 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 454/979] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:35 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:35.975668 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:35.976464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:35.982940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:35.983452 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:35.984319 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:35.984906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:36.130469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:36.137887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.165891 Dec 24 05:06:36.138723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 526/980] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:35 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:36.858723 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-50a96d8d-6995-41da-b532-4ef9f1c3d788 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:36.859863 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-50a96d8d-6995-41da-b532-4ef9f1c3d788 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:36.866691 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50a96d8d-6995-41da-b532-4ef9f1c3d788 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:36.867138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50a96d8d-6995-41da-b532-4ef9f1c3d788 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:36.867926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50a96d8d-6995-41da-b532-4ef9f1c3d788 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:36.868357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-50a96d8d-6995-41da-b532-4ef9f1c3d788 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:36.899032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-50a96d8d-6995-41da-b532-4ef9f1c3d788 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044686 Dec 24 05:06:36.899631 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 455/981] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:36 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:37.154775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:37.155472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:37.163085 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:37.163527 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:37.164307 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:37.164769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:37.305615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:37.313831 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cd4addde-3b07-4899-abec-2ac2e0c94239 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.162811 Dec 24 05:06:37.316336 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 527/982] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:37 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:37.911560 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b68ddd87-7cba-43b8-aeb2-9c2416857475 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:37.912628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b68ddd87-7cba-43b8-aeb2-9c2416857475 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:37.919023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b68ddd87-7cba-43b8-aeb2-9c2416857475 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:37.919458 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b68ddd87-7cba-43b8-aeb2-9c2416857475 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:37.920231 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b68ddd87-7cba-43b8-aeb2-9c2416857475 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:37.920689 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b68ddd87-7cba-43b8-aeb2-9c2416857475 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:37.952352 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b68ddd87-7cba-43b8-aeb2-9c2416857475 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045316 Dec 24 05:06:37.953238 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 456/983] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:37 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:38.334015 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:38.334665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:38.345562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:38.346357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:38.347163 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:38.347594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:38.490756 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:38.501950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-facc7743-1f11-4d16-8422-2fe17232792a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.173771 Dec 24 05:06:38.502565 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 528/984] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:38 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:38.964208 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d9cc4f25-8ee6-4e1d-a66f-c26e48132ceb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:38.965233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d9cc4f25-8ee6-4e1d-a66f-c26e48132ceb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:38.976183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9cc4f25-8ee6-4e1d-a66f-c26e48132ceb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:38.976794 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9cc4f25-8ee6-4e1d-a66f-c26e48132ceb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:38.977642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9cc4f25-8ee6-4e1d-a66f-c26e48132ceb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:38.978095 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d9cc4f25-8ee6-4e1d-a66f-c26e48132ceb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:39.009096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d9cc4f25-8ee6-4e1d-a66f-c26e48132ceb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048950 Dec 24 05:06:39.009671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 457/985] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:38 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:06:39.455289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:39.457799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:39.457799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:06:39.465537 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:39.466234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:39.483585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 service nova] Creating event network-changed:b8dc8fcb-f50d-49a3-9bd0-47110fdb068f for instance ae7a102d-4793-4384-bc31-07d28018c9df on hv-cinder-81644 Dec 24 05:06:39.492645 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041084 Dec 24 05:06:39.493456 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 529/986] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:06:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:06:39.519863 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:39.520468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:39.528166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:39.528928 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:39.529987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:39.530424 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:39.729690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:39.738321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a8fa743d-747b-45b9-8942-c15df227b267 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.222791 Dec 24 05:06:39.739008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 458/987] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:39 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:40.023558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-09fcf6cd-ed2b-4603-bb35-4705e807bdfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:40.024562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-09fcf6cd-ed2b-4603-bb35-4705e807bdfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:40.031473 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09fcf6cd-ed2b-4603-bb35-4705e807bdfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.031978 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09fcf6cd-ed2b-4603-bb35-4705e807bdfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.032789 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09fcf6cd-ed2b-4603-bb35-4705e807bdfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.033291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09fcf6cd-ed2b-4603-bb35-4705e807bdfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.066230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-09fcf6cd-ed2b-4603-bb35-4705e807bdfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047769 Dec 24 05:06:40.066802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 530/988] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:06:40 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:40.125396 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:40.125881 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:40.132587 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.133044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.133813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.134223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.160150 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:06:40.244821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-06ae393f-c8ec-4fa8-8071-7a0058565e0a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 204 len: 0 microversion: 2.20 time: 0.122378 Dec 24 05:06:40.245543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 459/989] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Dec 24 05:06:40 2021] DELETE /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 05:06:40.255160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:40.256246 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:40.263514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.264159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.265174 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.268585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.415050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:40.424012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:40.425530 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:40.426706 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ac3248eb-4854-4744-b726-e136fe95a344 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.176727 Dec 24 05:06:40.427262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 531/990] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:40 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:40.756912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:40.757525 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:40.764356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.764993 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.765770 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:40.766190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:40.907993 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:40.915687 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.163472 Dec 24 05:06:40.916476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 460/991] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:40 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:41.448083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:41.448720 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:41.456059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:41.456709 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:41.457652 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:41.458084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:41.602350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:41.614485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:41.616056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:41.617293 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f1783ad4-da70-4932-8259-ee13583613b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.174607 Dec 24 05:06:41.617966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 532/992] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:41 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:41.932563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:41.933170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:41.939808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:41.940233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:41.941171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:41.941598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:42.094995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:42.103582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-95c0d478-0fe3-40fd-94ae-f44faf970572 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.174581 Dec 24 05:06:42.104128 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 461/993] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:41 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:42.638937 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:42.640837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:42.648863 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:42.649654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:42.650524 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:42.651020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:42.801019 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:42.808865 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:42.810327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:42.811459 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-736a7898-2866-4ad6-8f51-9b5e60b9249e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1721 microversion: 2.20 time: 0.178959 Dec 24 05:06:42.817248 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 533/994] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:42 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:43.121180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:43.121951 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:43.133813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:43.134263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:43.135046 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:43.136094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:43.325025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-1d0bc9f8-c3c0-4ece-8808-2f419fd2adc2 req-b9186a82-c09d-4049-849b-a6e9dc5374d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-deleted", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:43.326810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:43.326810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:06:43.334625 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1d0bc9f8-c3c0-4ece-8808-2f419fd2adc2 req-b9186a82-c09d-4049-849b-a6e9dc5374d7 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:43.335106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1d0bc9f8-c3c0-4ece-8808-2f419fd2adc2 req-b9186a82-c09d-4049-849b-a6e9dc5374d7 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:43.348678 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-1d0bc9f8-c3c0-4ece-8808-2f419fd2adc2 req-b9186a82-c09d-4049-849b-a6e9dc5374d7 service nova] Creating event network-vif-deleted:61ec3441-5b75-4c07-b8ad-4174450d6a55 for instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 on hv-cinder-81644 Dec 24 05:06:43.352734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-1d0bc9f8-c3c0-4ece-8808-2f419fd2adc2 req-b9186a82-c09d-4049-849b-a6e9dc5374d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Dec 24 05:06:43.353677 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 534/995] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:06:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:06:43.371429 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:43.383987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-335ebafe-8a1a-4182-b496-7bb881b7fa5a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.266276 Dec 24 05:06:43.393671 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 462/996] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:43 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:43.838748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:43.840130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:43.848024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:43.848631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:43.849563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:43.850181 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:43.887414 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:43.888175 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:43.888773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lazy-loading 'fault' on Instance uuid 6485c286-d5e3-42e7-bf58-c4685f8c3066 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:06:43.934890 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:43.948623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:43.950215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:43.951468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 200 len: 1371 microversion: 2.20 time: 0.124869 Dec 24 05:06:43.952497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 535/997] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:43 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:44.401275 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:44.401911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:44.409312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:44.409803 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:44.410588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:44.411013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:44.564661 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:44.572272 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c154c429-7c47-490f-bd58-3b811d9023ce tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.175079 Dec 24 05:06:44.572866 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 463/998] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:44 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:44.971515 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:44.972335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:44.979599 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:44.980379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:44.981247 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:44.981669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:44.995566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] HTTP exception thrown: Instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 could not be found. Dec 24 05:06:44.996149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Returning 404 to user: Instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:06:44.997005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-740db0cd-4f25-4784-935d-27bd53d59671 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 404 len: 111 microversion: 2.20 time: 0.029701 Dec 24 05:06:44.997509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 536/999] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:44 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 05:06:45.006005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7fb32224-c925-4d9f-b8ab-75f04de2fa06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '.version_select at 0x7f7badee4550>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:45.026375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7fb32224-c925-4d9f-b8ab-75f04de2fa06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111329987" status: 204 len: 0 microversion: 2.20 time: 0.023971 Dec 24 05:06:45.026927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 464/1000] 10.222.0.43 () {60 vars in 1261 bytes} [Fri Dec 24 05:06:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111329987 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 05:06:45.588914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:45.589985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:45.597109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:45.597644 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:45.598564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:45.599092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:45.811211 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:45.820054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-577bb533-af51-46f9-9163-14354a547d50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.235502 Dec 24 05:06:45.820612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 537/1001] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:45 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:45.858436 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e73324f0-ddf6-4cb0-a056-a1368aa31673 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'create', calling method: .version_select at 0x7f7bade8f040>, body: {"keypair": {"name": "tempest-keypair-780678015"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:45.874210 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-e73324f0-ddf6-4cb0-a056-a1368aa31673 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:45.878121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-e73324f0-ddf6-4cb0-a056-a1368aa31673 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for user 979cc4a0723b4543a16197d393c7929a and project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:46.034956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-e73324f0-ddf6-4cb0-a056-a1368aa31673 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:46.039063 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-e73324f0-ddf6-4cb0-a056-a1368aa31673 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for user 979cc4a0723b4543a16197d393c7929a and project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:46.052439 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e73324f0-ddf6-4cb0-a056-a1368aa31673 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.198350 Dec 24 05:06:46.053131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 465/1002] 10.222.0.43 () {62 vars in 1198 bytes} [Fri Dec 24 05:06:45 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 24 05:06:46.836973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:46.838294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:46.846184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:46.846631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:46.847416 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:46.847875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:47.063229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:47.071256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.238496 Dec 24 05:06:47.071813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 538/1003] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:46 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:47.475717 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1587170327", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c908572e-3b6b-470c-8b88-35b51f1472c6"}], "security_groups": [{"name": "tempest-securitygroup--837497056"}], "key_name": "tempest-keypair-780678015", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:47.584175 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] validate_networks() for [('c908572e-3b6b-470c-8b88-35b51f1472c6', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:06:47.969823 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:06:47.970500 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:06:47.972226 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:06:47.972709 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:06:47.973144 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:06:47.983115 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:47.983572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:47.984356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:47.984816 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:48.002277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:48.007001 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Getting quotas for user 979cc4a0723b4543a16197d393c7929a and project 6c9c47f70b8d4da5827a8ef4349559ab. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:48.017785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:06:48.020106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:06:48.069469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.601493 Dec 24 05:06:48.070330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 466/1004] 10.222.0.43 () {62 vars in 1187 bytes} [Fri Dec 24 05:06:47 2021] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 24 05:06:48.080127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-31bf8bfe-90e9-4f9f-8e56-05590d1dc677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:48.081739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-31bf8bfe-90e9-4f9f-8e56-05590d1dc677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:48.089858 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:48.091178 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:48.097288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:48.097835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:48.099018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:48.099672 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:48.159418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-31bf8bfe-90e9-4f9f-8e56-05590d1dc677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:48.173194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-31bf8bfe-90e9-4f9f-8e56-05590d1dc677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:48.175983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-31bf8bfe-90e9-4f9f-8e56-05590d1dc677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:48.177477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-31bf8bfe-90e9-4f9f-8e56-05590d1dc677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1281 microversion: 2.20 time: 0.101062 Dec 24 05:06:48.179305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 539/1005] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:48 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:48.192841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-81ac7c92-78c4-427a-b138-b9ace38755c3 req-68bc7cf8-6111-4500-848d-6b80e8d75d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "name": "network-vif-plugged", "status": "completed", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:48.195628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:48.195628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:06:48.203720 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-81ac7c92-78c4-427a-b138-b9ace38755c3 req-68bc7cf8-6111-4500-848d-6b80e8d75d13 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:48.204142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-81ac7c92-78c4-427a-b138-b9ace38755c3 req-68bc7cf8-6111-4500-848d-6b80e8d75d13 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:48.216402 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-81ac7c92-78c4-427a-b138-b9ace38755c3 req-68bc7cf8-6111-4500-848d-6b80e8d75d13 service nova] Creating event network-vif-plugged:b8dc8fcb-f50d-49a3-9bd0-47110fdb068f for instance ae7a102d-4793-4384-bc31-07d28018c9df on hv-cinder-81644 Dec 24 05:06:48.221665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-81ac7c92-78c4-427a-b138-b9ace38755c3 req-68bc7cf8-6111-4500-848d-6b80e8d75d13 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040855 Dec 24 05:06:48.222464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 540/1006] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:06:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:06:48.242839 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:48.250492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.165241 Dec 24 05:06:48.251370 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 467/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:48 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:06:49.198391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:49.199061 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:49.205790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:49.206195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:49.206963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:49.207386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:49.267160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:49.268156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:49.269733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:49.277583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:49.278276 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:49.278953 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:49.279438 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:49.280020 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:49.280418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:49.281674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-de88eb41-6429-439f-b803-b7bacf083f79 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1333 microversion: 2.20 time: 0.088147 Dec 24 05:06:49.282597 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 541/1008] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:49 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:49.420134 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:49.427847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f14df40e-13b4-4494-abd9-0ef9334d4954 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1359 microversion: 2.1 time: 0.164417 Dec 24 05:06:49.428505 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 468/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:49 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:50.300152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:50.300784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:50.307811 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.308613 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:50.309607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.310249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:50.445406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:50.446697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:50.453836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.454593 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:50.455566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.456155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:50.616054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:50.624200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:50.625736 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:50.626858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-65a50654-804d-4e5d-bcf5-59d653cea036 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.330471 Dec 24 05:06:50.627401 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 542/1010] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:50 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:50.689159 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:50.697571 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-74808803-f60b-45ad-80ad-7a5c2951d8bd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1548 microversion: 2.1 time: 0.256253 Dec 24 05:06:50.698142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 469/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:50 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:50.713804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:50.714397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:50.720271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.720755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:50.721858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.721994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:50.874197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:50.882303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-00df4c98-f46d-46e2-b177-a3787256415e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1548 microversion: 2.1 time: 0.172635 Dec 24 05:06:50.883133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 543/1012] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:50 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:50.897930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:50.901349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:50.901349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:06:50.902364 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:50.903109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Searching by: {'deleted': False, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1'} {{(pid=116329) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 24 05:06:50.911133 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.911632 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:50.912817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:50.913496 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:51.004982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.multi_cell_list [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116329) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 24 05:06:51.103888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9e7b0d3a-267e-41ed-b7d0-5d33d5e4a70a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209513 Dec 24 05:06:51.104458 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 470/1013] 10.222.0.43 () {58 vars in 1124 bytes} [Fri Dec 24 05:06:50 2021] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:06:51.114505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:51.115103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:51.121193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:51.121629 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:51.122417 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:51.122838 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:51.253508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-98783733-df3e-41db-85bd-5d3aa25f7ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:51.255042 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:51.255042 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:06:51.268006 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-82d6e028-426e-4212-aeff-49822e411c53 req-98783733-df3e-41db-85bd-5d3aa25f7ba0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:51.268874 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-82d6e028-426e-4212-aeff-49822e411c53 req-98783733-df3e-41db-85bd-5d3aa25f7ba0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:51.279581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:51.287812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cb899afd-e4f3-4400-aabc-43eaa1867f7f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1548 microversion: 2.1 time: 0.176848 Dec 24 05:06:51.288300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-82d6e028-426e-4212-aeff-49822e411c53 req-98783733-df3e-41db-85bd-5d3aa25f7ba0 service nova] Creating event network-changed:8f0b0287-0281-4556-ae15-8fe2c2dbf50d for instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 on hv-cinder-81644 Dec 24 05:06:51.299740 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 544/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:51 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:51.302118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-82d6e028-426e-4212-aeff-49822e411c53 req-98783733-df3e-41db-85bd-5d3aa25f7ba0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052344 Dec 24 05:06:51.304183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 471/1015] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:06:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:06:51.646160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:51.647203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:51.654356 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:51.654874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:51.655722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:51.656139 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:51.800991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:51.811098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:51.813832 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:51.815911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d298e7be-159d-413d-8dfe-b72b82aff71c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.173422 Dec 24 05:06:51.817052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 545/1016] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:51 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:52.840113 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:52.841753 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:52.848430 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:52.848880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:52.849809 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:52.850277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:53.012664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:53.027206 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:53.028417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:53.030091 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-255e1bf1-9b51-4c23-8f47-510daa90c06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.197868 Dec 24 05:06:53.030861 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 472/1017] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:52 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:53.894533 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-85e3637e-04c2-4b00-901d-07645e1da5b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b6290ee-cb02-404b-a693-7078c7a0692a"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:53.895717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-85e3637e-04c2-4b00-901d-07645e1da5b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:53.902973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85e3637e-04c2-4b00-901d-07645e1da5b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:53.903419 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85e3637e-04c2-4b00-901d-07645e1da5b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:53.904178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85e3637e-04c2-4b00-901d-07645e1da5b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:53.904658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-85e3637e-04c2-4b00-901d-07645e1da5b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:54.050340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:54.050953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:54.058062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:54.058605 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:54.059382 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:54.059806 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:54.189670 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-85e3637e-04c2-4b00-901d-07645e1da5b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298827 Dec 24 05:06:54.190583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 546/1018] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:06:53 2021] POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:06:54.204479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:54.214953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:54.216431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:54.217560 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.171216 Dec 24 05:06:54.218132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 473/1019] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:54 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:55.242798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:55.243786 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:55.255137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:55.256055 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:55.257327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:55.257759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:55.391896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:55.400029 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:55.401547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:55.402627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c77a405c-6f0d-4644-96ee-cab813c7cffb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.168119 Dec 24 05:06:55.403182 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 547/1020] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:55 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:56.424237 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:56.425184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:56.433171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:56.433609 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:56.434370 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:56.434792 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:56.566896 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:56.575555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:56.577034 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:56.578136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b58a46c7-3369-4588-be4f-51075006302e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.160030 Dec 24 05:06:56.578697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 474/1021] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:56 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:57.217760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1362404591", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1364510469", "security_groups": [{"name": "tempest-secgroup-smoke-2046201915"}], "block_device_mapping_v2": [{"uuid": "b047793d-9900-498a-8cda-2a295ad90c9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df2331c3-0dd0-460e-980f-1e2409baa35e"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:57.347753 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] validate_networks() for [('df2331c3-0dd0-460e-980f-1e2409baa35e', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:06:57.595626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:57.597017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:57.603796 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:57.604556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:57.605459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:57.605944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:57.719258 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:06:57.719672 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:06:57.720131 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:06:57.720518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:06:57.721009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:06:57.729713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:57.730151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:57.731068 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:57.731493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:57.739306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:57.748367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:57.748519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:06:57.750008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:57.751199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fc365926-bafd-4f50-80fc-ccde256130cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.159126 Dec 24 05:06:57.756821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 475/1022] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:57 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:06:57.756950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for user 4039d5c6890448ee99194d769c5c387b and project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:06:57.807902 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:06:57.810089 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b047793d-9900-498a-8cda-2a295ad90c9c',volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:06:57.946186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6124fd64-e024-4224-8b30-9ab40c253c7b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731969 Dec 24 05:06:57.947048 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 548/1023] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:06:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:06:57.957536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-40af9fd2-3ea1-4166-bde4-c8b12315ddde tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:57.958167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-40af9fd2-3ea1-4166-bde4-c8b12315ddde tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:58.011788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-40af9fd2-3ea1-4166-bde4-c8b12315ddde tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:58.018871 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-40af9fd2-3ea1-4166-bde4-c8b12315ddde tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1095 microversion: 2.1 time: 0.065185 Dec 24 05:06:58.019531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 476/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:57 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:58.256745 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-bd195c13-f11c-43c9-b1e0-fae95da4d761 req-f29aead5-2c63-49c4-a07c-24b5c40ed334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:06:58.258328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:58.258328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:06:58.266220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-bd195c13-f11c-43c9-b1e0-fae95da4d761 req-f29aead5-2c63-49c4-a07c-24b5c40ed334 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:58.266832 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-bd195c13-f11c-43c9-b1e0-fae95da4d761 req-f29aead5-2c63-49c4-a07c-24b5c40ed334 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:58.281010 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-bd195c13-f11c-43c9-b1e0-fae95da4d761 req-f29aead5-2c63-49c4-a07c-24b5c40ed334 service nova] Creating event network-vif-plugged:8f0b0287-0281-4556-ae15-8fe2c2dbf50d for instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 on hv-cinder-81644 Dec 24 05:06:58.286016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-bd195c13-f11c-43c9-b1e0-fae95da4d761 req-f29aead5-2c63-49c4-a07c-24b5c40ed334 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032958 Dec 24 05:06:58.286784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 549/1025] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:06:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:06:58.773424 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:58.774314 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:58.784960 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:58.785927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:58.787247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:58.787998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:58.942628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:58.953400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:58.954866 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:58.955963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.189043 Dec 24 05:06:58.956503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 477/1026] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:58 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:06:59.038417 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:59.039012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:59.045919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:59.046354 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:59.047116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:59.047566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:59.108728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:06:59.116501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1193 microversion: 2.1 time: 0.082397 Dec 24 05:06:59.117088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 550/1027] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:06:59 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:06:59.974637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:06:59.975289 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:06:59.982749 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:59.983190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:06:59.983957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:06:59.984413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:00.133823 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:00.134790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:00.141594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:00.142038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:00.142825 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:00.143259 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:00.229115 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:00.237245 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:00.239406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:00.240550 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1406 microversion: 2.20 time: 0.269996 Dec 24 05:07:00.251353 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 478/1028] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:06:59 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:07:00.291499 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:00.299998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-67e06036-630a-4a36-b889-01107fbeeea3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1279 microversion: 2.1 time: 0.169725 Dec 24 05:07:00.300488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 551/1029] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:00 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:07:00.924730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:00.926670 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:07:00.926670 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:07:00.944221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:00.944956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:00.958701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 service nova] Creating event network-changed:f25ccd41-53b3-4bb9-84e1-824627c3e8e6 for instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 on hv-cinder-81644 Dec 24 05:07:00.964750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045390 Dec 24 05:07:00.965353 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 479/1030] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:07:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:07:01.258922 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:01.259528 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:01.266322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.266773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:01.267564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.267993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:01.318472 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:01.319166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:01.326023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.326557 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:01.327469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.328024 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:01.419087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:01.427117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:01.428816 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:01.430207 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2ccd32cd-444e-491e-8827-2642259c32b5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1597 microversion: 2.20 time: 0.175204 Dec 24 05:07:01.431126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 552/1031] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:07:01 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1597 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:07:01.447682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a495644c-c92d-45e9-972c-ec8d3a9ec814 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:01.448274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a495644c-c92d-45e9-972c-ec8d3a9ec814 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:01.454106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a495644c-c92d-45e9-972c-ec8d3a9ec814 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.454680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a495644c-c92d-45e9-972c-ec8d3a9ec814 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:01.455463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a495644c-c92d-45e9-972c-ec8d3a9ec814 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.455874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a495644c-c92d-45e9-972c-ec8d3a9ec814 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:01.518311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:01.527922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1279 microversion: 2.1 time: 0.214101 Dec 24 05:07:01.529099 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 480/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:01 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:07:01.548105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a495644c-c92d-45e9-972c-ec8d3a9ec814 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104480 Dec 24 05:07:01.548932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 553/1033] 10.222.0.43 () {60 vars in 1315 bytes} [Fri Dec 24 05:07:01 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:07:01.770151 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:01.770759 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:01.779885 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.780326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:01.781335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:01.782345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:02.014570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:02.023661 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3d122597-c78d-453d-a19b-f9b072418252 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1594 microversion: 2.1 time: 0.256681 Dec 24 05:07:02.032640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 481/1034] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:01 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1594 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:02.550680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:02.551389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:02.557534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:02.558306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:02.559344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:02.560151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:02.828797 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:02.836815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.291862 Dec 24 05:07:02.847862 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 554/1035] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:02 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:03.012424 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-79718795-5359-49bd-850f-b776f9d38db6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:03.013432 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-79718795-5359-49bd-850f-b776f9d38db6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:03.020650 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79718795-5359-49bd-850f-b776f9d38db6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:03.021103 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79718795-5359-49bd-850f-b776f9d38db6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:03.021963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79718795-5359-49bd-850f-b776f9d38db6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:03.022759 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-79718795-5359-49bd-850f-b776f9d38db6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:03.089537 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-075b1b56-2f14-4a97-90fc-43f08087ef29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:03.091133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:07:03.091133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:07:03.097874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8a7d1aa2-6187-4973-a563-26848e60681b req-075b1b56-2f14-4a97-90fc-43f08087ef29 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:03.098516 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8a7d1aa2-6187-4973-a563-26848e60681b req-075b1b56-2f14-4a97-90fc-43f08087ef29 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:03.108021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-79718795-5359-49bd-850f-b776f9d38db6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.099661 Dec 24 05:07:03.113590 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 482/1036] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:03 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:03.114500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-8a7d1aa2-6187-4973-a563-26848e60681b req-075b1b56-2f14-4a97-90fc-43f08087ef29 service nova] Creating event network-changed:8f0b0287-0281-4556-ae15-8fe2c2dbf50d for instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 on hv-cinder-81644 Dec 24 05:07:03.120485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-8a7d1aa2-6187-4973-a563-26848e60681b req-075b1b56-2f14-4a97-90fc-43f08087ef29 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102850 Dec 24 05:07:03.121339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 555/1037] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:07:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:07:03.856368 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:03.857274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:03.864222 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:03.864788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:03.865562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:03.865978 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:04.120416 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2633f242-a528-4ddc-8741-83294889b956 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:04.122250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2633f242-a528-4ddc-8741-83294889b956 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:04.128357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2633f242-a528-4ddc-8741-83294889b956 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:04.129020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2633f242-a528-4ddc-8741-83294889b956 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:04.129979 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2633f242-a528-4ddc-8741-83294889b956 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:04.130441 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2633f242-a528-4ddc-8741-83294889b956 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:04.176455 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:04.186366 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f2912832-8ae5-4fad-9170-d7fbdb509f09 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.334003 Dec 24 05:07:04.187262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 483/1038] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:03 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:04.230558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2633f242-a528-4ddc-8741-83294889b956 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.113975 Dec 24 05:07:04.234265 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 556/1039] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:04 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:04.639457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-32990b0c-aa61-4722-a097-06ae062b6978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:04.641064 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:07:04.641064 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:07:04.649720 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-32990b0c-aa61-4722-a097-06ae062b6978 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:04.650162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-32990b0c-aa61-4722-a097-06ae062b6978 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:04.660551 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-32990b0c-aa61-4722-a097-06ae062b6978 service nova] Creating event network-changed:b8dc8fcb-f50d-49a3-9bd0-47110fdb068f for instance ae7a102d-4793-4384-bc31-07d28018c9df on hv-cinder-81644 Dec 24 05:07:04.665945 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-32990b0c-aa61-4722-a097-06ae062b6978 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030105 Dec 24 05:07:04.666780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 484/1040] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:07:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:07:05.206196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:05.207532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:05.216717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:05.217362 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:05.218879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:05.219311 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:05.243782 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b282ddc4-7d13-4f93-8071-eef4ccfd7430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:05.245614 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b282ddc4-7d13-4f93-8071-eef4ccfd7430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:05.252813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b282ddc4-7d13-4f93-8071-eef4ccfd7430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:05.253530 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b282ddc4-7d13-4f93-8071-eef4ccfd7430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:05.254600 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b282ddc4-7d13-4f93-8071-eef4ccfd7430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:05.255177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b282ddc4-7d13-4f93-8071-eef4ccfd7430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:05.359065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b282ddc4-7d13-4f93-8071-eef4ccfd7430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.120231 Dec 24 05:07:05.363131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 485/1041] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:05 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:05.423773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:05.432432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f548bae8-c85b-4150-ac61-bfd45b432c27 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.231685 Dec 24 05:07:05.433356 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 557/1042] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:05 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:05.795885 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1293532538"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:05.796507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:05.803301 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:05.803744 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:05.804972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:05.805410 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:05.941039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.network.security_group_api [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Adding security group bc3c93b3-eec1-4f52-a952-c229f892877e to port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f Dec 24 05:07:06.307017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/action" status: 202 len: 0 microversion: 2.1 time: 0.515852 Dec 24 05:07:06.309404 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 486/1043] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:07:05 2021] POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:06.317353 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:06.318737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:06.331272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:06.332110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:06.333630 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:06.334218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:06.369938 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e93fcea9-26fa-45b4-892e-96b859565fa7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:06.371223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e93fcea9-26fa-45b4-892e-96b859565fa7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:06.388308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e93fcea9-26fa-45b4-892e-96b859565fa7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:06.389031 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e93fcea9-26fa-45b4-892e-96b859565fa7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:06.389887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e93fcea9-26fa-45b4-892e-96b859565fa7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:06.390490 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e93fcea9-26fa-45b4-892e-96b859565fa7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:06.499755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e93fcea9-26fa-45b4-892e-96b859565fa7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.133890 Dec 24 05:07:06.504561 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 487/1044] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:06 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:07:06.512831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:06.513825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:06.518329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:06.521039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:06.521470 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:06.522415 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:06.523137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:06.527467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1759 microversion: 2.1 time: 0.213730 Dec 24 05:07:06.528619 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 558/1045] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:06 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1759 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:06.668835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:06.676687 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e18ec0e8-6e1a-4642-9569-58634453b75d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.169689 Dec 24 05:07:06.677258 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 488/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:06 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:06.681849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-0f38a084-c560-4cb5-a776-b1886302f06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:06.683653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:07:06.683653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:07:06.690847 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-0f38a084-c560-4cb5-a776-b1886302f06f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:06.691287 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-0f38a084-c560-4cb5-a776-b1886302f06f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:06.702298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-0f38a084-c560-4cb5-a776-b1886302f06f service nova] Creating event network-changed:b8dc8fcb-f50d-49a3-9bd0-47110fdb068f for instance ae7a102d-4793-4384-bc31-07d28018c9df on hv-cinder-81644 Dec 24 05:07:06.707294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-0f38a084-c560-4cb5-a776-b1886302f06f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030082 Dec 24 05:07:06.708045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 559/1047] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:07:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:07:07.519341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-15c9ecbc-1586-4fef-b33f-982c7030f218 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:07.520790 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-15c9ecbc-1586-4fef-b33f-982c7030f218 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:07.528323 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15c9ecbc-1586-4fef-b33f-982c7030f218 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:07.528791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15c9ecbc-1586-4fef-b33f-982c7030f218 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:07.529555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15c9ecbc-1586-4fef-b33f-982c7030f218 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:07.529974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-15c9ecbc-1586-4fef-b33f-982c7030f218 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:07.615320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-15c9ecbc-1586-4fef-b33f-982c7030f218 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.101675 Dec 24 05:07:07.616371 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 489/1048] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:07 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:07.694885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:07.695692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:07.702518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:07.702960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:07.703712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:07.704144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:07.846090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:07.854220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-77c01fec-9650-4d0d-9856-699d7626a140 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.163945 Dec 24 05:07:07.854746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 560/1049] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:07 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:08.631916 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5f4bcc47-f032-4394-ba84-0e118152eb54 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:08.633961 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5f4bcc47-f032-4394-ba84-0e118152eb54 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:08.641137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5f4bcc47-f032-4394-ba84-0e118152eb54 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:08.641575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5f4bcc47-f032-4394-ba84-0e118152eb54 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:08.642336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5f4bcc47-f032-4394-ba84-0e118152eb54 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:08.642750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5f4bcc47-f032-4394-ba84-0e118152eb54 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:08.727412 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5f4bcc47-f032-4394-ba84-0e118152eb54 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.102221 Dec 24 05:07:08.728018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 490/1050] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:08 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:08.874138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:08.874950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:08.884628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:08.885189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:08.886535 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:08.887162 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:09.028653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:09.035987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-713a1fb5-33d3-4755-ad3c-2ea95747334a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.167637 Dec 24 05:07:09.036513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 561/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:08 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:09.742535 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-72e261d7-67e0-4360-8856-60eea7b42773 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:09.743930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-72e261d7-67e0-4360-8856-60eea7b42773 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:09.751093 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72e261d7-67e0-4360-8856-60eea7b42773 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:09.751531 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72e261d7-67e0-4360-8856-60eea7b42773 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:09.752343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72e261d7-67e0-4360-8856-60eea7b42773 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:09.752740 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-72e261d7-67e0-4360-8856-60eea7b42773 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:09.844716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-72e261d7-67e0-4360-8856-60eea7b42773 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.108814 Dec 24 05:07:09.845349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 491/1052] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:09 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:10.057746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:10.058890 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:10.069077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:10.069800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:10.070964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:10.072210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:10.218706 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:10.226424 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-878a24af-88bc-4be3-874f-ea4383ad1f81 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.175838 Dec 24 05:07:10.226964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 562/1053] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:10 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:07:10.856783 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b48d2fef-019e-45d3-a3c5-5b0c4d978e6e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:10.857789 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b48d2fef-019e-45d3-a3c5-5b0c4d978e6e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:10.865308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b48d2fef-019e-45d3-a3c5-5b0c4d978e6e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:10.865751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b48d2fef-019e-45d3-a3c5-5b0c4d978e6e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:10.866533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b48d2fef-019e-45d3-a3c5-5b0c4d978e6e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:10.866954 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b48d2fef-019e-45d3-a3c5-5b0c4d978e6e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:11.112028 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b48d2fef-019e-45d3-a3c5-5b0c4d978e6e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.259471 Dec 24 05:07:11.113365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 492/1054] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:10 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:11.245989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:11.246668 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:11.254294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:11.254815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:11.255717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:11.256220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:11.399292 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:11.407324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3d91354a-2095-426f-af00-1cf59e63d021 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.166581 Dec 24 05:07:11.407874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 563/1055] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:11 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:12.129100 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8dd89fbc-ccd5-4b1a-ab45-d379961d3536 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:12.130780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8dd89fbc-ccd5-4b1a-ab45-d379961d3536 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:12.142469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8dd89fbc-ccd5-4b1a-ab45-d379961d3536 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:12.144128 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8dd89fbc-ccd5-4b1a-ab45-d379961d3536 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:12.144429 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8dd89fbc-ccd5-4b1a-ab45-d379961d3536 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:12.145181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8dd89fbc-ccd5-4b1a-ab45-d379961d3536 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:12.240321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8dd89fbc-ccd5-4b1a-ab45-d379961d3536 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 14 microversion: 2.20 time: 0.117054 Dec 24 05:07:12.241471 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 493/1056] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:12 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:12.328431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-c795c3b9-b160-4e73-860a-69bb9f2790af req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "name": "network-vif-plugged", "status": "completed", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:12.330133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:07:12.330133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:07:12.339477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-c795c3b9-b160-4e73-860a-69bb9f2790af req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:12.339921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-c795c3b9-b160-4e73-860a-69bb9f2790af req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:12.351357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-c795c3b9-b160-4e73-860a-69bb9f2790af req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 service nova] Creating event network-vif-plugged:f25ccd41-53b3-4bb9-84e1-824627c3e8e6 for instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 on hv-cinder-81644 Dec 24 05:07:12.356855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-c795c3b9-b160-4e73-860a-69bb9f2790af req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032897 Dec 24 05:07:12.357452 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 564/1057] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:07:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:07:12.424288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:12.425000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:12.432309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:12.432791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:12.433567 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:12.434019 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:12.585970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:12.594171 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b706f69b-6349-478c-8e21-bb713811231d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.173992 Dec 24 05:07:12.594914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 494/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:12 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:13.256841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-30955bd8-ded8-4527-941d-90389f77e388 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:13.258449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-30955bd8-ded8-4527-941d-90389f77e388 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:13.265828 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30955bd8-ded8-4527-941d-90389f77e388 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:13.266273 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30955bd8-ded8-4527-941d-90389f77e388 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:13.267038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30955bd8-ded8-4527-941d-90389f77e388 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:13.267462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-30955bd8-ded8-4527-941d-90389f77e388 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:13.380616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-30955bd8-ded8-4527-941d-90389f77e388 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 6451 microversion: 2.20 time: 0.129950 Dec 24 05:07:13.381621 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 565/1059] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:13 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 6451 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:07:13.616579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:13.617582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:13.624847 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:13.625288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:13.626061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:13.626485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:13.781705 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:13.789498 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2635a05d-cc75-4b37-a0f4-37d1fd668940 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1267 microversion: 2.1 time: 0.179045 Dec 24 05:07:13.790194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 495/1060] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:13 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:14.396943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-090b1d26-ee6b-42d7-8c5e-09866fb4fd8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:14.398546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-090b1d26-ee6b-42d7-8c5e-09866fb4fd8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:14.405945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-090b1d26-ee6b-42d7-8c5e-09866fb4fd8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:14.406379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-090b1d26-ee6b-42d7-8c5e-09866fb4fd8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:14.407138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-090b1d26-ee6b-42d7-8c5e-09866fb4fd8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:14.407561 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-090b1d26-ee6b-42d7-8c5e-09866fb4fd8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:14.508252 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-090b1d26-ee6b-42d7-8c5e-09866fb4fd8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 15025 microversion: 2.20 time: 0.117882 Dec 24 05:07:14.509149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 566/1061] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:14 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 15025 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:14.810753 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:14.811726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:14.822274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:14.822725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:14.823507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:14.823934 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:14.961649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:14.969617 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1452 microversion: 2.1 time: 0.165389 Dec 24 05:07:14.970160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 496/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:14 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:14.994498 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:07:14.995188 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:15.002293 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:15.002729 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:15.003527 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:15.003949 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:15.151886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:07:15.163773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-58267493-0de5-4246-ae41-4c6e859a99b8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1452 microversion: 2.1 time: 0.174972 Dec 24 05:07:15.164490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 567/1063] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:07:14 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:07:15.520654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6c4c902d-73e9-43c3-9811-61e23f631d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:15.521582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6c4c902d-73e9-43c3-9811-61e23f631d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:15.527840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c4c902d-73e9-43c3-9811-61e23f631d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:15.528276 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c4c902d-73e9-43c3-9811-61e23f631d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:15.529077 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c4c902d-73e9-43c3-9811-61e23f631d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:15.529503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c4c902d-73e9-43c3-9811-61e23f631d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:15.624136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6c4c902d-73e9-43c3-9811-61e23f631d78 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 18498 microversion: 2.20 time: 0.106798 Dec 24 05:07:15.624775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 497/1064] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:15 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 18498 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:16.635642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-84263271-6a59-45f3-a250-4da77e540720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:16.636723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-84263271-6a59-45f3-a250-4da77e540720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:16.643447 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84263271-6a59-45f3-a250-4da77e540720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:16.643884 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84263271-6a59-45f3-a250-4da77e540720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:16.644703 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84263271-6a59-45f3-a250-4da77e540720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:16.645113 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-84263271-6a59-45f3-a250-4da77e540720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:16.735556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-84263271-6a59-45f3-a250-4da77e540720 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 19342 microversion: 2.20 time: 0.103763 Dec 24 05:07:16.736323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 568/1065] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:16 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 19342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:17.190787 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-067887bb-1f26-4dc3-9ca3-f6386e275329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:17.193463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:07:17.193463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:07:17.201451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-067887bb-1f26-4dc3-9ca3-f6386e275329 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:17.202041 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-067887bb-1f26-4dc3-9ca3-f6386e275329 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:17.213908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-067887bb-1f26-4dc3-9ca3-f6386e275329 service nova] Creating event network-changed:f25ccd41-53b3-4bb9-84e1-824627c3e8e6 for instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 on hv-cinder-81644 Dec 24 05:07:17.218742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-067887bb-1f26-4dc3-9ca3-f6386e275329 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032632 Dec 24 05:07:17.219329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 498/1066] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:07:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:07:17.748026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-69f99174-6c48-4abc-a93d-8c350a76e54e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:17.749214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-69f99174-6c48-4abc-a93d-8c350a76e54e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:17.756071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69f99174-6c48-4abc-a93d-8c350a76e54e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:17.756810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69f99174-6c48-4abc-a93d-8c350a76e54e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:17.757841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69f99174-6c48-4abc-a93d-8c350a76e54e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:17.758474 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-69f99174-6c48-4abc-a93d-8c350a76e54e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:17.868594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-69f99174-6c48-4abc-a93d-8c350a76e54e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 22168 microversion: 2.20 time: 0.124569 Dec 24 05:07:17.870016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 569/1067] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:17 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 22168 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 24 05:07:18.885865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fab02f96-adb3-459d-9c62-f1438dcb4677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:18.887512 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fab02f96-adb3-459d-9c62-f1438dcb4677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:18.898333 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab02f96-adb3-459d-9c62-f1438dcb4677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:18.899076 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab02f96-adb3-459d-9c62-f1438dcb4677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:18.900447 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab02f96-adb3-459d-9c62-f1438dcb4677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:18.900910 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab02f96-adb3-459d-9c62-f1438dcb4677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:18.995348 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fab02f96-adb3-459d-9c62-f1438dcb4677 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 23804 microversion: 2.20 time: 0.116117 Dec 24 05:07:18.996049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 499/1068] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:18 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 23804 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:20.010932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-968d6340-67e0-4afc-b9d0-680be683b6c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:20.011864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-968d6340-67e0-4afc-b9d0-680be683b6c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:20.018798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968d6340-67e0-4afc-b9d0-680be683b6c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:20.019230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968d6340-67e0-4afc-b9d0-680be683b6c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:20.019993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968d6340-67e0-4afc-b9d0-680be683b6c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:20.020412 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-968d6340-67e0-4afc-b9d0-680be683b6c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:20.111506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-968d6340-67e0-4afc-b9d0-680be683b6c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 24960 microversion: 2.20 time: 0.106760 Dec 24 05:07:20.112132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 570/1069] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:20 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 24960 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:21.125003 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3623d3e6-d20c-4b4c-999a-fad18d7512b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:21.126003 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3623d3e6-d20c-4b4c-999a-fad18d7512b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:21.133004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3623d3e6-d20c-4b4c-999a-fad18d7512b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:21.133441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3623d3e6-d20c-4b4c-999a-fad18d7512b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:21.134211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3623d3e6-d20c-4b4c-999a-fad18d7512b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:21.134628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3623d3e6-d20c-4b4c-999a-fad18d7512b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:21.249408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3623d3e6-d20c-4b4c-999a-fad18d7512b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 26547 microversion: 2.20 time: 0.128263 Dec 24 05:07:21.250114 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 500/1070] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:21 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 26547 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:22.266280 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2b183c38-d062-42a9-8787-1cf948d06b13 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:22.267265 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2b183c38-d062-42a9-8787-1cf948d06b13 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:22.274566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b183c38-d062-42a9-8787-1cf948d06b13 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:22.275007 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b183c38-d062-42a9-8787-1cf948d06b13 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:22.275778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b183c38-d062-42a9-8787-1cf948d06b13 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:22.276197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2b183c38-d062-42a9-8787-1cf948d06b13 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:22.369998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2b183c38-d062-42a9-8787-1cf948d06b13 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 27642 microversion: 2.20 time: 0.109887 Dec 24 05:07:22.370893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 571/1071] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:22 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 27642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:23.387722 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4c276df5-d12a-4c9c-b16b-2ea3baf363ab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:23.388817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4c276df5-d12a-4c9c-b16b-2ea3baf363ab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:23.397137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c276df5-d12a-4c9c-b16b-2ea3baf363ab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:23.397654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c276df5-d12a-4c9c-b16b-2ea3baf363ab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:23.398553 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c276df5-d12a-4c9c-b16b-2ea3baf363ab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:23.399082 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4c276df5-d12a-4c9c-b16b-2ea3baf363ab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:23.496731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4c276df5-d12a-4c9c-b16b-2ea3baf363ab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 27923 microversion: 2.20 time: 0.115145 Dec 24 05:07:23.497438 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 501/1072] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:23 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 27923 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:24.513597 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-15dd2f36-427a-4354-9704-3b4f34fa3015 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:24.515176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-15dd2f36-427a-4354-9704-3b4f34fa3015 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:24.526289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15dd2f36-427a-4354-9704-3b4f34fa3015 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:24.526725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15dd2f36-427a-4354-9704-3b4f34fa3015 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:24.527486 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15dd2f36-427a-4354-9704-3b4f34fa3015 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:24.527927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-15dd2f36-427a-4354-9704-3b4f34fa3015 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:24.622766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-15dd2f36-427a-4354-9704-3b4f34fa3015 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.115270 Dec 24 05:07:24.623724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 572/1073] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:24 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:25.639980 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-aa18da06-20a7-4cd2-aabe-69c13057958b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:25.641026 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-aa18da06-20a7-4cd2-aabe-69c13057958b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:25.648169 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aa18da06-20a7-4cd2-aabe-69c13057958b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:25.648637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aa18da06-20a7-4cd2-aabe-69c13057958b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:25.649421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aa18da06-20a7-4cd2-aabe-69c13057958b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:25.649840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-aa18da06-20a7-4cd2-aabe-69c13057958b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:25.738928 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-aa18da06-20a7-4cd2-aabe-69c13057958b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.102864 Dec 24 05:07:25.739878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 502/1074] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:25 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:26.753128 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-df453e74-4497-4245-ab00-8e405f426871 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:26.754260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-df453e74-4497-4245-ab00-8e405f426871 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:26.763284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df453e74-4497-4245-ab00-8e405f426871 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:26.763839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df453e74-4497-4245-ab00-8e405f426871 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:26.764866 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df453e74-4497-4245-ab00-8e405f426871 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:26.765396 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df453e74-4497-4245-ab00-8e405f426871 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:26.860989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-df453e74-4497-4245-ab00-8e405f426871 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.112450 Dec 24 05:07:26.861991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 573/1075] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:26 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:27.878037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-68158d4c-a1e7-44fe-9476-b885a4342edf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:27.879382 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-68158d4c-a1e7-44fe-9476-b885a4342edf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:27.888313 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68158d4c-a1e7-44fe-9476-b885a4342edf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:27.888785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68158d4c-a1e7-44fe-9476-b885a4342edf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:27.889565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68158d4c-a1e7-44fe-9476-b885a4342edf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:27.889987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-68158d4c-a1e7-44fe-9476-b885a4342edf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:27.980842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-68158d4c-a1e7-44fe-9476-b885a4342edf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.108418 Dec 24 05:07:27.981572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 503/1076] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:27 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:28.993478 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fb972b5a-ec73-4388-8f57-92f3dbcdba0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:28.994513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fb972b5a-ec73-4388-8f57-92f3dbcdba0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:29.001867 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb972b5a-ec73-4388-8f57-92f3dbcdba0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:29.002313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb972b5a-ec73-4388-8f57-92f3dbcdba0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:29.003093 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb972b5a-ec73-4388-8f57-92f3dbcdba0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:29.003519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb972b5a-ec73-4388-8f57-92f3dbcdba0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:29.105963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fb972b5a-ec73-4388-8f57-92f3dbcdba0e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.116055 Dec 24 05:07:29.106660 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 574/1077] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:28 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:30.123775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0d0f43f5-ddf3-4085-97f9-3b83103fd394 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:30.125408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0d0f43f5-ddf3-4085-97f9-3b83103fd394 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:30.136123 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d0f43f5-ddf3-4085-97f9-3b83103fd394 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:30.136565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d0f43f5-ddf3-4085-97f9-3b83103fd394 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:30.137365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d0f43f5-ddf3-4085-97f9-3b83103fd394 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:30.137788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0d0f43f5-ddf3-4085-97f9-3b83103fd394 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:30.264567 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0d0f43f5-ddf3-4085-97f9-3b83103fd394 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.147195 Dec 24 05:07:30.265588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 504/1078] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:30 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:31.283849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4b41df8b-c4f1-40d6-bb29-001e67ca6cb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:31.285564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4b41df8b-c4f1-40d6-bb29-001e67ca6cb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:31.297197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b41df8b-c4f1-40d6-bb29-001e67ca6cb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:31.297943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b41df8b-c4f1-40d6-bb29-001e67ca6cb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:31.299231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b41df8b-c4f1-40d6-bb29-001e67ca6cb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:31.299947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b41df8b-c4f1-40d6-bb29-001e67ca6cb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:31.399581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4b41df8b-c4f1-40d6-bb29-001e67ca6cb6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.122087 Dec 24 05:07:31.400712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 575/1079] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:31 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:32.414330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d2e07edf-5f89-4f97-9d42-0b553c08e411 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:32.415338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d2e07edf-5f89-4f97-9d42-0b553c08e411 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:32.422627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2e07edf-5f89-4f97-9d42-0b553c08e411 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:32.423071 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2e07edf-5f89-4f97-9d42-0b553c08e411 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:32.423850 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2e07edf-5f89-4f97-9d42-0b553c08e411 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:32.424286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d2e07edf-5f89-4f97-9d42-0b553c08e411 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:32.515742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d2e07edf-5f89-4f97-9d42-0b553c08e411 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.104902 Dec 24 05:07:32.516704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 505/1080] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:32 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:33.534487 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9cbca441-ca7d-4645-9f7b-6df52ba81460 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:33.536138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9cbca441-ca7d-4645-9f7b-6df52ba81460 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:33.547693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9cbca441-ca7d-4645-9f7b-6df52ba81460 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:33.548428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9cbca441-ca7d-4645-9f7b-6df52ba81460 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:33.549748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9cbca441-ca7d-4645-9f7b-6df52ba81460 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:33.550445 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9cbca441-ca7d-4645-9f7b-6df52ba81460 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:33.642977 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9cbca441-ca7d-4645-9f7b-6df52ba81460 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.114715 Dec 24 05:07:33.643851 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 576/1081] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:33 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:34.662313 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-76d02598-2a9e-43e8-a4a3-4323c293d00c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:34.663858 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-76d02598-2a9e-43e8-a4a3-4323c293d00c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:34.672813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76d02598-2a9e-43e8-a4a3-4323c293d00c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:34.673256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76d02598-2a9e-43e8-a4a3-4323c293d00c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:34.674023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76d02598-2a9e-43e8-a4a3-4323c293d00c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:34.674454 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-76d02598-2a9e-43e8-a4a3-4323c293d00c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:34.767151 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-76d02598-2a9e-43e8-a4a3-4323c293d00c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.111403 Dec 24 05:07:34.767997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 506/1082] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:34 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:35.782314 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cf3012aa-b383-4b72-8f40-e72b6be80c30 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:35.783353 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cf3012aa-b383-4b72-8f40-e72b6be80c30 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:35.790841 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3012aa-b383-4b72-8f40-e72b6be80c30 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:35.791298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3012aa-b383-4b72-8f40-e72b6be80c30 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:35.792093 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3012aa-b383-4b72-8f40-e72b6be80c30 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:35.792569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cf3012aa-b383-4b72-8f40-e72b6be80c30 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:35.891104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cf3012aa-b383-4b72-8f40-e72b6be80c30 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.112527 Dec 24 05:07:35.891987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 577/1083] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:35 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:36.910199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f30b07c5-3e20-4208-a025-ed8eb06283cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:36.912241 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f30b07c5-3e20-4208-a025-ed8eb06283cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:36.922530 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30b07c5-3e20-4208-a025-ed8eb06283cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:36.922966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30b07c5-3e20-4208-a025-ed8eb06283cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:36.923744 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30b07c5-3e20-4208-a025-ed8eb06283cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:36.924158 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f30b07c5-3e20-4208-a025-ed8eb06283cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:37.029237 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f30b07c5-3e20-4208-a025-ed8eb06283cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28190 microversion: 2.20 time: 0.126059 Dec 24 05:07:37.030188 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 507/1084] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:36 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28190 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:38.046655 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fb94809d-3dbf-4fbd-bb67-517bcfa74d05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:38.047569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fb94809d-3dbf-4fbd-bb67-517bcfa74d05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:38.054778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb94809d-3dbf-4fbd-bb67-517bcfa74d05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:38.055221 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb94809d-3dbf-4fbd-bb67-517bcfa74d05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:38.055999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb94809d-3dbf-4fbd-bb67-517bcfa74d05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:38.056429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb94809d-3dbf-4fbd-bb67-517bcfa74d05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:38.150066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fb94809d-3dbf-4fbd-bb67-517bcfa74d05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28419 microversion: 2.20 time: 0.109869 Dec 24 05:07:38.150836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 578/1085] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:38 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28419 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:39.165811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b615e92b-12f5-4caa-a499-d9460a19fa5c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:39.167096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b615e92b-12f5-4caa-a499-d9460a19fa5c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:39.177924 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b615e92b-12f5-4caa-a499-d9460a19fa5c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:39.178539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b615e92b-12f5-4caa-a499-d9460a19fa5c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:39.179612 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b615e92b-12f5-4caa-a499-d9460a19fa5c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:39.180179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b615e92b-12f5-4caa-a499-d9460a19fa5c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:39.279456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b615e92b-12f5-4caa-a499-d9460a19fa5c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28481 microversion: 2.20 time: 0.119281 Dec 24 05:07:39.280217 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 508/1086] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:39 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28481 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:40.296151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a7add71b-a7bc-4d8c-bea9-15149fdb696b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:40.297178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a7add71b-a7bc-4d8c-bea9-15149fdb696b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:40.304623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7add71b-a7bc-4d8c-bea9-15149fdb696b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:40.305073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7add71b-a7bc-4d8c-bea9-15149fdb696b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:40.305847 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7add71b-a7bc-4d8c-bea9-15149fdb696b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:40.306273 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a7add71b-a7bc-4d8c-bea9-15149fdb696b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:40.408649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a7add71b-a7bc-4d8c-bea9-15149fdb696b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.118713 Dec 24 05:07:40.409654 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 579/1087] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:40 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:41.424152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-abda7992-8ab0-441f-aec5-822015f35483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:41.425252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-abda7992-8ab0-441f-aec5-822015f35483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:41.432875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abda7992-8ab0-441f-aec5-822015f35483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:41.433326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abda7992-8ab0-441f-aec5-822015f35483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:41.434129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abda7992-8ab0-441f-aec5-822015f35483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:41.434641 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abda7992-8ab0-441f-aec5-822015f35483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:41.529955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-abda7992-8ab0-441f-aec5-822015f35483 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.109710 Dec 24 05:07:41.530815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 509/1088] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:41 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:42.545331 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a4f04bf8-2d2e-47fc-b51d-8103d07ea324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:42.546494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a4f04bf8-2d2e-47fc-b51d-8103d07ea324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:42.553861 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4f04bf8-2d2e-47fc-b51d-8103d07ea324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:42.554341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4f04bf8-2d2e-47fc-b51d-8103d07ea324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:42.555116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4f04bf8-2d2e-47fc-b51d-8103d07ea324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:42.555543 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4f04bf8-2d2e-47fc-b51d-8103d07ea324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:42.639440 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a4f04bf8-2d2e-47fc-b51d-8103d07ea324 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.099901 Dec 24 05:07:42.640189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 580/1089] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:42 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:43.654229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c93b7d2c-c10e-498f-995c-499ca96fb84f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:43.655319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c93b7d2c-c10e-498f-995c-499ca96fb84f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:43.664308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c93b7d2c-c10e-498f-995c-499ca96fb84f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:43.664952 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c93b7d2c-c10e-498f-995c-499ca96fb84f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:43.665948 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c93b7d2c-c10e-498f-995c-499ca96fb84f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:43.666458 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c93b7d2c-c10e-498f-995c-499ca96fb84f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:43.754519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c93b7d2c-c10e-498f-995c-499ca96fb84f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.105414 Dec 24 05:07:43.755262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 510/1090] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:43 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:44.767559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b0755a04-d289-437b-8be8-f767115f19bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:44.768476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b0755a04-d289-437b-8be8-f767115f19bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:44.775771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0755a04-d289-437b-8be8-f767115f19bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:44.776216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0755a04-d289-437b-8be8-f767115f19bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:44.777038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0755a04-d289-437b-8be8-f767115f19bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:44.777464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b0755a04-d289-437b-8be8-f767115f19bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:44.871763 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b0755a04-d289-437b-8be8-f767115f19bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.108848 Dec 24 05:07:44.872712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 581/1091] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:44 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:45.887213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-70b45e57-4471-4f0d-a2ca-b1cf93a64c28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:45.888244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-70b45e57-4471-4f0d-a2ca-b1cf93a64c28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:45.895507 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-70b45e57-4471-4f0d-a2ca-b1cf93a64c28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:45.895952 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-70b45e57-4471-4f0d-a2ca-b1cf93a64c28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:45.896772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-70b45e57-4471-4f0d-a2ca-b1cf93a64c28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:45.897198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-70b45e57-4471-4f0d-a2ca-b1cf93a64c28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:45.983947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-70b45e57-4471-4f0d-a2ca-b1cf93a64c28 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.100759 Dec 24 05:07:45.984710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 511/1092] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:45 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:47.002421 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a26f0899-5ae9-43cd-850c-308920d4c346 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:47.003966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a26f0899-5ae9-43cd-850c-308920d4c346 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:47.017004 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a26f0899-5ae9-43cd-850c-308920d4c346 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:47.017615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a26f0899-5ae9-43cd-850c-308920d4c346 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:47.018571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a26f0899-5ae9-43cd-850c-308920d4c346 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:47.019323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a26f0899-5ae9-43cd-850c-308920d4c346 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:47.108948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a26f0899-5ae9-43cd-850c-308920d4c346 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.113215 Dec 24 05:07:47.109769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 582/1093] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:46 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:48.122457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ca62126c-4711-49e3-a205-ef7333101874 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:48.123528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ca62126c-4711-49e3-a205-ef7333101874 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:48.131487 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca62126c-4711-49e3-a205-ef7333101874 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:48.132007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca62126c-4711-49e3-a205-ef7333101874 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:48.132884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca62126c-4711-49e3-a205-ef7333101874 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:48.133370 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca62126c-4711-49e3-a205-ef7333101874 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:48.219908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ca62126c-4711-49e3-a205-ef7333101874 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.101810 Dec 24 05:07:48.220548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 512/1094] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:48 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:49.233703 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-73cc4887-4967-47d5-9abe-e63c310f56a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:49.234852 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-73cc4887-4967-47d5-9abe-e63c310f56a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:49.244593 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73cc4887-4967-47d5-9abe-e63c310f56a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:49.245104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73cc4887-4967-47d5-9abe-e63c310f56a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:49.245869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73cc4887-4967-47d5-9abe-e63c310f56a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:49.246296 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-73cc4887-4967-47d5-9abe-e63c310f56a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:49.342947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-73cc4887-4967-47d5-9abe-e63c310f56a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.113237 Dec 24 05:07:49.343920 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 583/1095] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:49 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:50.357006 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-929fe159-6cc8-4ea7-bf27-f122fc74c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:50.358058 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-929fe159-6cc8-4ea7-bf27-f122fc74c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:50.368321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-929fe159-6cc8-4ea7-bf27-f122fc74c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:50.368849 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-929fe159-6cc8-4ea7-bf27-f122fc74c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:50.369723 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-929fe159-6cc8-4ea7-bf27-f122fc74c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:50.370207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-929fe159-6cc8-4ea7-bf27-f122fc74c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:50.459294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-929fe159-6cc8-4ea7-bf27-f122fc74c0da tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.107148 Dec 24 05:07:50.459954 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 513/1096] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:50 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:51.474348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2541142b-09b6-4ca6-af82-7ad70775e06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:51.475350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2541142b-09b6-4ca6-af82-7ad70775e06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:51.482672 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2541142b-09b6-4ca6-af82-7ad70775e06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:51.483228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2541142b-09b6-4ca6-af82-7ad70775e06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:51.484216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2541142b-09b6-4ca6-af82-7ad70775e06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:51.484965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2541142b-09b6-4ca6-af82-7ad70775e06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:51.575337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2541142b-09b6-4ca6-af82-7ad70775e06b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.105597 Dec 24 05:07:51.575903 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 584/1097] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:51 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:52.590552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-57871d15-5424-4b92-bec4-7c5fde340494 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:52.592446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-57871d15-5424-4b92-bec4-7c5fde340494 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:52.602065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-57871d15-5424-4b92-bec4-7c5fde340494 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:52.602513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-57871d15-5424-4b92-bec4-7c5fde340494 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:52.603303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-57871d15-5424-4b92-bec4-7c5fde340494 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:52.603724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-57871d15-5424-4b92-bec4-7c5fde340494 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:52.703663 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-57871d15-5424-4b92-bec4-7c5fde340494 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.117083 Dec 24 05:07:52.704338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 514/1098] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:52 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:53.717780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75ad10dd-e1c4-40b9-a21d-aa7ebfeb7f35 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:53.719023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75ad10dd-e1c4-40b9-a21d-aa7ebfeb7f35 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:53.727592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75ad10dd-e1c4-40b9-a21d-aa7ebfeb7f35 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:53.728096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75ad10dd-e1c4-40b9-a21d-aa7ebfeb7f35 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:53.729142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75ad10dd-e1c4-40b9-a21d-aa7ebfeb7f35 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:53.729651 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75ad10dd-e1c4-40b9-a21d-aa7ebfeb7f35 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:53.818906 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75ad10dd-e1c4-40b9-a21d-aa7ebfeb7f35 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.105954 Dec 24 05:07:53.819674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 585/1099] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:53 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:54.832646 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9b32e507-4db3-4411-a820-2336dd8b8150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:54.833645 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9b32e507-4db3-4411-a820-2336dd8b8150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:54.841109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b32e507-4db3-4411-a820-2336dd8b8150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:54.841556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b32e507-4db3-4411-a820-2336dd8b8150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:54.842342 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b32e507-4db3-4411-a820-2336dd8b8150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:54.842772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9b32e507-4db3-4411-a820-2336dd8b8150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:54.932319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9b32e507-4db3-4411-a820-2336dd8b8150 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.103681 Dec 24 05:07:54.933155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 515/1100] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:54 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:55.950726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-372e7736-0570-49f7-a392-5590dd2fc97d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:55.952355 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-372e7736-0570-49f7-a392-5590dd2fc97d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:55.963960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-372e7736-0570-49f7-a392-5590dd2fc97d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:55.964736 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-372e7736-0570-49f7-a392-5590dd2fc97d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:55.966013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-372e7736-0570-49f7-a392-5590dd2fc97d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:55.966721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-372e7736-0570-49f7-a392-5590dd2fc97d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:56.053149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-372e7736-0570-49f7-a392-5590dd2fc97d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.109027 Dec 24 05:07:56.053702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 586/1101] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:55 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:57.068953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c063b577-f2e4-4ffd-895a-6d70a684cd3e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:57.070007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c063b577-f2e4-4ffd-895a-6d70a684cd3e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:57.077634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c063b577-f2e4-4ffd-895a-6d70a684cd3e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:57.078144 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c063b577-f2e4-4ffd-895a-6d70a684cd3e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:57.078965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c063b577-f2e4-4ffd-895a-6d70a684cd3e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:57.079673 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c063b577-f2e4-4ffd-895a-6d70a684cd3e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:57.178032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c063b577-f2e4-4ffd-895a-6d70a684cd3e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.113686 Dec 24 05:07:57.178966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 516/1102] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:57 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:58.196423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-213b9717-08ff-4bb8-be53-f07e03eebaa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:58.198064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-213b9717-08ff-4bb8-be53-f07e03eebaa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:58.208066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-213b9717-08ff-4bb8-be53-f07e03eebaa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:58.208504 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-213b9717-08ff-4bb8-be53-f07e03eebaa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:58.209294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-213b9717-08ff-4bb8-be53-f07e03eebaa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:58.209713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-213b9717-08ff-4bb8-be53-f07e03eebaa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:58.301849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-213b9717-08ff-4bb8-be53-f07e03eebaa4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.111862 Dec 24 05:07:58.302761 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 587/1103] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:58 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:07:59.318617 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-47109661-a780-41dc-9f8c-42cd82d93cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:07:59.319607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-47109661-a780-41dc-9f8c-42cd82d93cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:07:59.326923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47109661-a780-41dc-9f8c-42cd82d93cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:59.327363 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47109661-a780-41dc-9f8c-42cd82d93cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:59.328170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47109661-a780-41dc-9f8c-42cd82d93cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:07:59.328631 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-47109661-a780-41dc-9f8c-42cd82d93cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:07:59.423354 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-47109661-a780-41dc-9f8c-42cd82d93cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.109470 Dec 24 05:07:59.424765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 517/1104] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:07:59 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:00.444910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9ccdce36-8694-4eb3-b27d-d5c134036edb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:00.450096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9ccdce36-8694-4eb3-b27d-d5c134036edb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:00.465546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ccdce36-8694-4eb3-b27d-d5c134036edb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:00.466004 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ccdce36-8694-4eb3-b27d-d5c134036edb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:00.466802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ccdce36-8694-4eb3-b27d-d5c134036edb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:00.467232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ccdce36-8694-4eb3-b27d-d5c134036edb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:00.563133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9ccdce36-8694-4eb3-b27d-d5c134036edb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.126548 Dec 24 05:08:00.564257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 588/1105] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:00 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:01.582574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5581c60e-4916-43fc-a783-bc55a5e459c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:01.584080 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5581c60e-4916-43fc-a783-bc55a5e459c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:01.595976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5581c60e-4916-43fc-a783-bc55a5e459c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:01.596868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5581c60e-4916-43fc-a783-bc55a5e459c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:01.597940 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5581c60e-4916-43fc-a783-bc55a5e459c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:01.598361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5581c60e-4916-43fc-a783-bc55a5e459c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:01.691497 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5581c60e-4916-43fc-a783-bc55a5e459c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.115433 Dec 24 05:08:01.692311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 518/1106] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:01 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:02.706145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b3a96eca-0a21-43b3-9234-c7c5c401c008 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:02.708108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b3a96eca-0a21-43b3-9234-c7c5c401c008 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:02.715423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3a96eca-0a21-43b3-9234-c7c5c401c008 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:02.715884 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3a96eca-0a21-43b3-9234-c7c5c401c008 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:02.716671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3a96eca-0a21-43b3-9234-c7c5c401c008 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:02.717346 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b3a96eca-0a21-43b3-9234-c7c5c401c008 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:02.812344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b3a96eca-0a21-43b3-9234-c7c5c401c008 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.110192 Dec 24 05:08:02.813022 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 589/1107] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:02 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:03.829050 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7187335b-7f1d-439a-a0a0-1a250439d404 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:03.830678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7187335b-7f1d-439a-a0a0-1a250439d404 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:03.842526 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7187335b-7f1d-439a-a0a0-1a250439d404 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:03.843255 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7187335b-7f1d-439a-a0a0-1a250439d404 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:03.844516 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7187335b-7f1d-439a-a0a0-1a250439d404 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:03.845270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7187335b-7f1d-439a-a0a0-1a250439d404 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:03.934914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7187335b-7f1d-439a-a0a0-1a250439d404 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.112074 Dec 24 05:08:03.935880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 519/1108] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:03 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:04.953813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ac2b453d-ac7e-4d71-9db7-fccca81dec00 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:04.955420 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ac2b453d-ac7e-4d71-9db7-fccca81dec00 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:04.963630 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac2b453d-ac7e-4d71-9db7-fccca81dec00 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:04.964071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac2b453d-ac7e-4d71-9db7-fccca81dec00 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:04.964880 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac2b453d-ac7e-4d71-9db7-fccca81dec00 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:04.965302 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ac2b453d-ac7e-4d71-9db7-fccca81dec00 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:05.062418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ac2b453d-ac7e-4d71-9db7-fccca81dec00 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.114779 Dec 24 05:08:05.063455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 590/1109] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:04 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:06.082335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-54890a11-9a82-4952-9e2c-e2b8705443c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:06.083544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-54890a11-9a82-4952-9e2c-e2b8705443c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:06.095453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-54890a11-9a82-4952-9e2c-e2b8705443c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:06.096196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-54890a11-9a82-4952-9e2c-e2b8705443c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:06.097665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-54890a11-9a82-4952-9e2c-e2b8705443c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:06.098293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-54890a11-9a82-4952-9e2c-e2b8705443c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:06.201970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-54890a11-9a82-4952-9e2c-e2b8705443c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.126598 Dec 24 05:08:06.202685 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 520/1110] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:06 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:07.219227 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fb33ddd3-55d6-4cfd-9453-fd34c14ea2a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:07.220894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fb33ddd3-55d6-4cfd-9453-fd34c14ea2a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:07.232338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb33ddd3-55d6-4cfd-9453-fd34c14ea2a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:07.233125 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb33ddd3-55d6-4cfd-9453-fd34c14ea2a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:07.234398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb33ddd3-55d6-4cfd-9453-fd34c14ea2a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:07.235104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fb33ddd3-55d6-4cfd-9453-fd34c14ea2a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:07.330568 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fb33ddd3-55d6-4cfd-9453-fd34c14ea2a3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.117590 Dec 24 05:08:07.331555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 591/1111] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:07 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:08.345413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5e097af8-e479-4c15-9800-598305a743b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:08.346408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5e097af8-e479-4c15-9800-598305a743b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:08.354129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e097af8-e479-4c15-9800-598305a743b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:08.354570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e097af8-e479-4c15-9800-598305a743b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:08.355347 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e097af8-e479-4c15-9800-598305a743b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:08.355764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5e097af8-e479-4c15-9800-598305a743b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:08.445105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5e097af8-e479-4c15-9800-598305a743b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.103377 Dec 24 05:08:08.445962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 521/1112] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:08 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:09.462951 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-344f6850-315f-4328-93ff-bdfbde8051d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:09.464270 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-344f6850-315f-4328-93ff-bdfbde8051d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:09.473469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-344f6850-315f-4328-93ff-bdfbde8051d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:09.474008 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-344f6850-315f-4328-93ff-bdfbde8051d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:09.474963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-344f6850-315f-4328-93ff-bdfbde8051d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:09.475488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-344f6850-315f-4328-93ff-bdfbde8051d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:09.580826 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-344f6850-315f-4328-93ff-bdfbde8051d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.124007 Dec 24 05:08:09.581721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 592/1113] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:09 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:10.598942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5d8fe510-04ef-4070-866e-7f48601cc7c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:10.599904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5d8fe510-04ef-4070-866e-7f48601cc7c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:10.607526 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d8fe510-04ef-4070-866e-7f48601cc7c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:10.607994 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d8fe510-04ef-4070-866e-7f48601cc7c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:10.608876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d8fe510-04ef-4070-866e-7f48601cc7c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:10.609304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d8fe510-04ef-4070-866e-7f48601cc7c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:10.705284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5d8fe510-04ef-4070-866e-7f48601cc7c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 28649 microversion: 2.20 time: 0.112496 Dec 24 05:08:10.706329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 522/1114] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:10 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 28649 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:11.722988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-06d51345-4233-4bf0-81aa-26cc63af4f2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:11.724603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-06d51345-4233-4bf0-81aa-26cc63af4f2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:11.734285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06d51345-4233-4bf0-81aa-26cc63af4f2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:11.734900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06d51345-4233-4bf0-81aa-26cc63af4f2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:11.735982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06d51345-4233-4bf0-81aa-26cc63af4f2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:11.736578 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06d51345-4233-4bf0-81aa-26cc63af4f2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:11.834079 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-06d51345-4233-4bf0-81aa-26cc63af4f2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 29798 microversion: 2.20 time: 0.116669 Dec 24 05:08:11.834806 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 593/1115] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:11 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 29798 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:12.850263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-dfe2eb91-e35a-439c-ab37-f5974d490a7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:12.851347 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-dfe2eb91-e35a-439c-ab37-f5974d490a7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:12.859234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb91-e35a-439c-ab37-f5974d490a7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:12.859722 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb91-e35a-439c-ab37-f5974d490a7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:12.860582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb91-e35a-439c-ab37-f5974d490a7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:12.861074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dfe2eb91-e35a-439c-ab37-f5974d490a7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:12.959827 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-dfe2eb91-e35a-439c-ab37-f5974d490a7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 31791 microversion: 2.20 time: 0.115193 Dec 24 05:08:12.961017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 523/1116] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:12 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 31791 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:13.978563 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a735c9ba-116c-4e07-be8a-a5a0d75ddbca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:13.980445 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a735c9ba-116c-4e07-be8a-a5a0d75ddbca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:13.991035 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a735c9ba-116c-4e07-be8a-a5a0d75ddbca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:13.991470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a735c9ba-116c-4e07-be8a-a5a0d75ddbca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:13.992236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a735c9ba-116c-4e07-be8a-a5a0d75ddbca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:13.992689 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a735c9ba-116c-4e07-be8a-a5a0d75ddbca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:14.099735 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a735c9ba-116c-4e07-be8a-a5a0d75ddbca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 33317 microversion: 2.20 time: 0.127743 Dec 24 05:08:14.100801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 594/1117] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:13 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 33317 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:15.117106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9506bc77-e65a-4876-b8a7-20f2780cddd5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:15.118811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9506bc77-e65a-4876-b8a7-20f2780cddd5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:15.126497 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9506bc77-e65a-4876-b8a7-20f2780cddd5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:15.126932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9506bc77-e65a-4876-b8a7-20f2780cddd5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:15.127705 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9506bc77-e65a-4876-b8a7-20f2780cddd5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:15.128131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9506bc77-e65a-4876-b8a7-20f2780cddd5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:15.225461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9506bc77-e65a-4876-b8a7-20f2780cddd5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 34194 microversion: 2.20 time: 0.113242 Dec 24 05:08:15.226072 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 524/1118] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:15 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 34194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:16.242687 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-392d8c1d-6435-4a42-869f-72603a6f44be tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:16.244058 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-392d8c1d-6435-4a42-869f-72603a6f44be tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:16.255378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-392d8c1d-6435-4a42-869f-72603a6f44be tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:16.256096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-392d8c1d-6435-4a42-869f-72603a6f44be tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:16.257369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-392d8c1d-6435-4a42-869f-72603a6f44be tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:16.257949 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-392d8c1d-6435-4a42-869f-72603a6f44be tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:16.360758 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-392d8c1d-6435-4a42-869f-72603a6f44be tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 35421 microversion: 2.20 time: 0.125021 Dec 24 05:08:16.361397 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 595/1119] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:16 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 35421 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:17.377279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f882f5ab-a607-4cf9-ac0d-e606e3acd5dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:17.378548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f882f5ab-a607-4cf9-ac0d-e606e3acd5dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:17.386757 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f882f5ab-a607-4cf9-ac0d-e606e3acd5dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:17.387199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f882f5ab-a607-4cf9-ac0d-e606e3acd5dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:17.387970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f882f5ab-a607-4cf9-ac0d-e606e3acd5dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:17.388390 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f882f5ab-a607-4cf9-ac0d-e606e3acd5dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:17.492764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f882f5ab-a607-4cf9-ac0d-e606e3acd5dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 36848 microversion: 2.20 time: 0.121458 Dec 24 05:08:17.493627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 525/1120] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:17 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 36848 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:17.960822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:17.961850 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:17.969119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:17.969557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:17.970327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:17.970746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:18.043612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/action" status: 202 len: 0 microversion: 2.1 time: 0.087451 Dec 24 05:08:18.044169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 596/1121] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:08:17 2021] POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:18.052712 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:18.053948 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:18.060955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:18.061342 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:18.062126 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:18.062582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:18.267349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:18.275769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1751 microversion: 2.1 time: 0.227113 Dec 24 05:08:18.276351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 526/1122] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:18 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:18.508349 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-af5a0593-9b6f-4b65-b9ec-236d3650b532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:18.509364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-af5a0593-9b6f-4b65-b9ec-236d3650b532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:18.516091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5a0593-9b6f-4b65-b9ec-236d3650b532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:18.516553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5a0593-9b6f-4b65-b9ec-236d3650b532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:18.517342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5a0593-9b6f-4b65-b9ec-236d3650b532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:18.517797 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5a0593-9b6f-4b65-b9ec-236d3650b532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:18.626886 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-af5a0593-9b6f-4b65-b9ec-236d3650b532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 38207 microversion: 2.20 time: 0.122906 Dec 24 05:08:18.627724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 597/1123] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:18 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 38207 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:19.295684 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:19.296416 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:19.305058 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:19.305742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:19.306539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:19.306967 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:19.455403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:19.464107 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6f77780c-4ddc-455c-a335-d2acd043d6f7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.174449 Dec 24 05:08:19.464712 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 527/1124] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:19 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:19.644299 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1b43cbdd-7780-4dd2-a1f9-a8ba6f3a232f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:19.645994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1b43cbdd-7780-4dd2-a1f9-a8ba6f3a232f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:19.657984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b43cbdd-7780-4dd2-a1f9-a8ba6f3a232f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:19.658717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b43cbdd-7780-4dd2-a1f9-a8ba6f3a232f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:19.659989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b43cbdd-7780-4dd2-a1f9-a8ba6f3a232f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:19.660736 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1b43cbdd-7780-4dd2-a1f9-a8ba6f3a232f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:19.748264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1b43cbdd-7780-4dd2-a1f9-a8ba6f3a232f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 38207 microversion: 2.20 time: 0.110232 Dec 24 05:08:19.749291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 598/1125] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:19 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 38207 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:20.481441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:20.482058 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:20.488779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:20.489227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:20.490073 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:20.491099 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:20.647868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:20.655925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-64b4885a-c8c5-4144-b105-ff381a9bb1ed tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.178257 Dec 24 05:08:20.656565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 528/1126] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:20 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:20.769548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-97daceb9-815a-46db-920e-95ff32a3ee52 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:20.771888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-97daceb9-815a-46db-920e-95ff32a3ee52 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:20.779465 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97daceb9-815a-46db-920e-95ff32a3ee52 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:20.779908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97daceb9-815a-46db-920e-95ff32a3ee52 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:20.780722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97daceb9-815a-46db-920e-95ff32a3ee52 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:20.781146 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-97daceb9-815a-46db-920e-95ff32a3ee52 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:20.880674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-97daceb9-815a-46db-920e-95ff32a3ee52 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 38207 microversion: 2.20 time: 0.118854 Dec 24 05:08:20.881567 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 599/1127] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:20 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 38207 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:21.676813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:21.677611 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:21.688068 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:21.688822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:21.690632 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:21.691238 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:21.846572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:21.856361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ee29af08-fe70-4ab0-a918-78dba7fb7983 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.185618 Dec 24 05:08:21.857230 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 529/1128] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:21 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:21.897329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8446b0fd-deff-4e15-9c24-421345e3b3a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:21.898334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8446b0fd-deff-4e15-9c24-421345e3b3a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:21.905858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8446b0fd-deff-4e15-9c24-421345e3b3a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:21.906303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8446b0fd-deff-4e15-9c24-421345e3b3a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:21.907097 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8446b0fd-deff-4e15-9c24-421345e3b3a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:21.907514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8446b0fd-deff-4e15-9c24-421345e3b3a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:22.002551 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8446b0fd-deff-4e15-9c24-421345e3b3a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 38207 microversion: 2.20 time: 0.108998 Dec 24 05:08:22.003443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 600/1129] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:21 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 38207 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:22.882953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:22.883884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:22.894448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:22.895183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:22.896449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:22.897220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:23.017470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fe60293e-ffec-4fe8-af80-a1e7752b0acd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:23.018491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fe60293e-ffec-4fe8-af80-a1e7752b0acd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:23.025579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe60293e-ffec-4fe8-af80-a1e7752b0acd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:23.026020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe60293e-ffec-4fe8-af80-a1e7752b0acd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:23.026790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe60293e-ffec-4fe8-af80-a1e7752b0acd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:23.027210 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe60293e-ffec-4fe8-af80-a1e7752b0acd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:23.046774 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:23.056054 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3cbad2f4-b362-4d2c-8c9c-376413641e16 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.179343 Dec 24 05:08:23.056660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 530/1130] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:22 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:23.127933 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fe60293e-ffec-4fe8-af80-a1e7752b0acd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 200 len: 38350 microversion: 2.20 time: 0.114876 Dec 24 05:08:23.128587 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 601/1131] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:23 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 38350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:08:23.138783 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-400a7000-9df1-4f49-9514-dc392ad5b6cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:23.139257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-400a7000-9df1-4f49-9514-dc392ad5b6cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:23.145666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-400a7000-9df1-4f49-9514-dc392ad5b6cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:23.146102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-400a7000-9df1-4f49-9514-dc392ad5b6cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:23.146864 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-400a7000-9df1-4f49-9514-dc392ad5b6cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:23.147275 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-400a7000-9df1-4f49-9514-dc392ad5b6cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:23.170461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-400a7000-9df1-4f49-9514-dc392ad5b6cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/ips" status: 200 len: 151 microversion: 2.20 time: 0.035446 Dec 24 05:08:23.171000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 531/1132] 10.222.0.43 () {60 vars in 1288 bytes} [Fri Dec 24 05:08:23 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:08:24.078481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:24.079631 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:24.091539 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:24.092248 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:24.093582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:24.094288 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:24.246952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:24.259193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c633779f-4c08-401f-8435-8cc005ccf260 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.187752 Dec 24 05:08:24.259762 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 602/1133] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:24 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:25.278503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:25.279121 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:25.285735 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:25.286176 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:25.286950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:25.287373 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:25.435296 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:25.443322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.169731 Dec 24 05:08:25.443929 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 532/1134] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:25 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:26.468466 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:26.478547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:26.478547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:26.478547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:26.479269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:26.479693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:26.637026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:26.649824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.187199 Dec 24 05:08:26.650730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 603/1135] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:26 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:27.672303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:27.673644 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:27.680659 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:27.681108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:27.681906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:27.682336 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:27.882576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:27.891152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1a732ca5-f86f-4656-b006-63f309747a74 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.222560 Dec 24 05:08:27.891821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 533/1136] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:27 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:28.917738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:28.918799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:28.930082 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:28.930527 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:28.931333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:28.931763 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:29.088192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:29.096840 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3753b7aa-028c-4c6c-ace7-749b703b651d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1756 microversion: 2.1 time: 0.185545 Dec 24 05:08:29.097476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 604/1137] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:28 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:30.119176 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:30.120160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:30.130729 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:30.131628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:30.133109 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:30.133884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:30.302828 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:30.310912 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1759 microversion: 2.1 time: 0.198086 Dec 24 05:08:30.318455 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 534/1138] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:08:30 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:08:40.780168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:40.781169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:40.788993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:40.789457 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:40.790206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:40.790627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:40.815805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lazy-loading 'flavor' on Instance uuid cc21b91f-c07f-40f8-8cf1-a9c343386f03 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:08:41.089279 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-acffec12-1103-44f0-b492-f2f4601b80a8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 202 len: 0 microversion: 2.20 time: 0.315174 Dec 24 05:08:41.089991 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 605/1139] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:08:40 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:08:41.098504 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:41.099066 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:41.106223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:41.106716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:41.107613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:41.108168 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:41.244973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:41.253066 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:41.254540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:41.255692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.161312 Dec 24 05:08:41.256212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 535/1140] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:41 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:42.279348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:42.280462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:42.288682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:42.289126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:42.289891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:42.290310 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:42.432712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:42.444838 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:42.447054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:42.448833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-01302268-5c08-48ca-a472-c0c4e3a4bccc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.176950 Dec 24 05:08:42.449583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 606/1141] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:42 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:43.472743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:43.473732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:43.484461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:43.485274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:43.486527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:43.487235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:43.634602 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:43.642976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:43.644480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:43.645662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ad906e32-d910-486f-bf80-8bc8266b076c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.179046 Dec 24 05:08:43.646219 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 536/1142] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:43 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:44.666200 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:44.667030 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:44.675599 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:44.676044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:44.676842 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:44.677274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:44.828849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:44.837451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:44.838904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:44.840054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4b1745b3-57df-4e82-9747-f159e58252c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.178671 Dec 24 05:08:44.840622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 607/1143] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:44 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:45.862301 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:45.864286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:45.875102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:45.875843 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:45.877191 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:45.877905 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:46.017034 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:46.028944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:46.031211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:46.032986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.176696 Dec 24 05:08:46.033754 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 537/1144] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:45 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:47.061670 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:47.062726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:47.070846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:47.071283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:47.072066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:47.072493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:47.205158 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:47.217691 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:47.220116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:47.221918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c5df75d0-c3c3-400b-b880-40ffd3c8336b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.166167 Dec 24 05:08:47.222470 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 608/1145] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:47 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:48.244274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:48.245307 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:48.255968 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:48.256758 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:48.258012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:48.258707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:48.399328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:48.411061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:48.412548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:48.413696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e339c066-aa20-4b65-b009-ef418f80f839 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.175613 Dec 24 05:08:48.414255 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 538/1146] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:48 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:49.432475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:49.433166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:49.440112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:49.440655 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:49.441437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:49.441839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:49.577128 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:49.585343 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:49.587170 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:49.588328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.159751 Dec 24 05:08:49.588905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 609/1147] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:49 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:50.616209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:50.617004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:50.625398 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:50.625943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:50.626925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:50.627462 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:50.768940 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:50.781198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:50.783600 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:50.785437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0177255c-98a3-4e4c-8349-dc6515b23b06 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.174953 Dec 24 05:08:50.786007 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 539/1148] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:50 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:51.804916 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:51.805520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:51.811852 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:51.812289 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:51.813086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:51.813508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:51.946521 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:51.954901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:51.956827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:51.957986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e25617ff-98c1-4b38-bcbe-68457d388089 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.157134 Dec 24 05:08:51.958580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 610/1149] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:51 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:52.980039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:52.981049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:52.991757 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:52.992501 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:52.993808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:52.994516 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:53.134927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:53.147710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:53.150031 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:53.151797 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1743 microversion: 2.20 time: 0.177811 Dec 24 05:08:53.152626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 540/1150] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:52 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:54.177788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:54.178981 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:54.189822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:54.190371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:54.191339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:54.192056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:54.358337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:54.367255 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:54.369582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:54.371408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-67e15678-abdd-455d-9d16-3fc34bb95c48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1743 microversion: 2.20 time: 0.200159 Dec 24 05:08:54.372359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 611/1151] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:54 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:55.391081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:55.391676 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:55.398139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:55.398588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:55.399393 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:55.399820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:55.537293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:55.545027 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:55.546607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:55.547746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b27c7492-c4b8-4f02-9857-737604cd19a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1743 microversion: 2.20 time: 0.160532 Dec 24 05:08:55.548307 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 541/1152] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:55 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:56.565772 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:56.566384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:56.573534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:56.573911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:56.574697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:56.575114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:56.716011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:56.724583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:56.726120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:56.727275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8b33b610-4103-4ea3-9573-335d1f1a9829 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1743 microversion: 2.20 time: 0.165453 Dec 24 05:08:56.727849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 612/1153] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:56 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:56.809831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-e9bcf3b3-b285-440c-b057-93aed2903697 req-5d8bbae4-e409-4676-8010-902fb415a1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:08:56.811431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:08:56.811431 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:08:56.819653 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-e9bcf3b3-b285-440c-b057-93aed2903697 req-5d8bbae4-e409-4676-8010-902fb415a1d0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:56.820137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-e9bcf3b3-b285-440c-b057-93aed2903697 req-5d8bbae4-e409-4676-8010-902fb415a1d0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:56.831475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-e9bcf3b3-b285-440c-b057-93aed2903697 req-5d8bbae4-e409-4676-8010-902fb415a1d0 service nova] Creating event network-vif-plugged:8f0b0287-0281-4556-ae15-8fe2c2dbf50d for instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 on hv-cinder-81644 Dec 24 05:08:56.837135 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-e9bcf3b3-b285-440c-b057-93aed2903697 req-5d8bbae4-e409-4676-8010-902fb415a1d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030893 Dec 24 05:08:56.837732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 542/1154] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:08:57.749483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:57.750363 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:57.760978 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:57.761719 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:57.763003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:57.763717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:57.903335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:57.912694 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:57.913713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:57.915134 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-141ae250-49dd-4ba3-8115-fff8db22771b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1743 microversion: 2.20 time: 0.172054 Dec 24 05:08:57.915692 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 613/1155] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:57 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:08:58.936582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:08:58.937342 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:08:58.944318 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:58.945621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:58.947236 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:08:58.948009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:08:59.112330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:59.121663 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:59.123166 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:08:59.124358 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.192751 Dec 24 05:08:59.124957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 543/1156] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:08:58 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:00.144003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:00.144767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:00.153747 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:00.154497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:00.155293 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:00.155745 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:00.324084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:00.336784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:00.347564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:00.348808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a85b65d5-44b4-498a-893f-9a82b7b7d073 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.209478 Dec 24 05:09:00.360965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 614/1157] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:00 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:01.369898 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:01.370693 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:01.378861 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:01.379300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:01.380149 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:01.380732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:01.523937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:01.532696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:01.534243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:01.535653 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6a12aea0-0729-4279-a214-627dd00f2de0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.170623 Dec 24 05:09:01.536653 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 544/1158] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:01 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:02.554917 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:02.555569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:02.567907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:02.568271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:02.569889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:02.570326 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:02.726570 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:02.738974 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:02.740509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:02.742437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a02e1f88-5497-4271-b47e-21d8b4cc44fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.191441 Dec 24 05:09:02.743156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 615/1159] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:02 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:03.761195 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:03.762193 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:03.768286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:03.768793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:03.769706 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:03.770136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:03.915972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:03.925278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:03.927106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:03.928666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5b19c244-77de-4db5-a6bd-c8bea3439e6b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.171439 Dec 24 05:09:03.929567 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 545/1160] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:03 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:04.949596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:04.950427 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:04.959688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:04.960169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:04.961408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:04.961833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:05.113141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:05.125312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:05.126793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:05.127960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bae67733-c5d3-4859-abbf-36b1bfd58405 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.182081 Dec 24 05:09:05.128545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 616/1161] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:04 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:06.152017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:06.152622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:06.159479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:06.159914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:06.160716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:06.161139 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:06.298875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:06.309857 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:06.311420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:06.312749 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.165114 Dec 24 05:09:06.324142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 546/1162] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:06 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:07.332066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:07.332695 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:07.339646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:07.340088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:07.340883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:07.341305 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:07.484423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:07.493254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:07.494713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:07.495845 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1738 microversion: 2.20 time: 0.167576 Dec 24 05:09:07.496404 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 617/1163] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:07 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:08.517696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:08.518532 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:08.526977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:08.527432 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:08.528208 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:08.528674 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:08.668204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:08.683312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:08.685299 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:08.687040 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-12dcc922-c162-41f2-acbf-359e78bf9468 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1720 microversion: 2.20 time: 0.175364 Dec 24 05:09:08.687878 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 547/1164] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:08 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:09.711095 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:09.711676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:09.718491 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:09.718929 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:09.719724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:09.720141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:09.922615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:09.932482 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:09.933977 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:09.935092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1720 microversion: 2.20 time: 0.230314 Dec 24 05:09:09.935685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 618/1165] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:09 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:10.850692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-2098120b-a920-4fe7-bbc9-175cf6c6afd1 req-aa5798fb-999f-41a5-98fc-c231197a5645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-unplugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:10.852235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:10.852235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:09:10.860262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-2098120b-a920-4fe7-bbc9-175cf6c6afd1 req-aa5798fb-999f-41a5-98fc-c231197a5645 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:10.860736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-2098120b-a920-4fe7-bbc9-175cf6c6afd1 req-aa5798fb-999f-41a5-98fc-c231197a5645 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:10.873401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.compute.server_external_events [req-2098120b-a920-4fe7-bbc9-175cf6c6afd1 req-aa5798fb-999f-41a5-98fc-c231197a5645 service nova] Unable to find a host for instance cc21b91f-c07f-40f8-8cf1-a9c343386f03. Dropping event network-vif-unplugged {{(pid=116329) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 24 05:09:10.874265 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-2098120b-a920-4fe7-bbc9-175cf6c6afd1 req-aa5798fb-999f-41a5-98fc-c231197a5645 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027750 Dec 24 05:09:10.874868 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 548/1166] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 24 05:09:10.953695 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:10.954304 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:10.961573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:10.962021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:10.962793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:10.963223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:11.300671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:11.309023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:11.310515 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:11.311684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1663 microversion: 2.20 time: 0.361891 Dec 24 05:09:11.312215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 619/1167] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:10 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1663 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:11.336149 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-77d3f155-0172-488a-acba-ca361954bb7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "206faa44-e541-4d13-997a-8a5f135d562e"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:11.337243 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-77d3f155-0172-488a-acba-ca361954bb7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:11.343685 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77d3f155-0172-488a-acba-ca361954bb7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:11.344126 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77d3f155-0172-488a-acba-ca361954bb7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:11.344949 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77d3f155-0172-488a-acba-ca361954bb7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:11.345399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77d3f155-0172-488a-acba-ca361954bb7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:11.725919 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-77d3f155-0172-488a-acba-ca361954bb7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.395419 Dec 24 05:09:11.726523 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 549/1168] 10.222.0.43 () {62 vars in 1363 bytes} [Fri Dec 24 05:09:11 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-volume_attachments => generated 188 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:09:11.859481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f55ae3fa-1c28-4845-98ea-ce0373f2520d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:11.860119 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f55ae3fa-1c28-4845-98ea-ce0373f2520d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:11.866785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f55ae3fa-1c28-4845-98ea-ce0373f2520d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:11.867231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f55ae3fa-1c28-4845-98ea-ce0373f2520d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:11.868005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f55ae3fa-1c28-4845-98ea-ce0373f2520d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:11.868440 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f55ae3fa-1c28-4845-98ea-ce0373f2520d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:12.134678 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f55ae3fa-1c28-4845-98ea-ce0373f2520d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-volume_attachments/206faa44-e541-4d13-997a-8a5f135d562e" status: 202 len: 0 microversion: 2.20 time: 0.278955 Dec 24 05:09:12.135382 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 620/1169] 10.222.0.43 () {60 vars in 1456 bytes} [Fri Dec 24 05:09:11 2021] DELETE /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-volume_attachments/206faa44-e541-4d13-997a-8a5f135d562e => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:09:12.192326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:12.192910 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:12.202472 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:12.203105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:12.204211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:12.204879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:12.297122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action" status: 202 len: 0 microversion: 2.20 time: 0.110646 Dec 24 05:09:12.297631 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 550/1170] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Dec 24 05:09:12 2021] POST /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:09:12.305923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:12.307319 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:12.314418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:12.314857 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:12.315683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:12.316173 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:12.479838 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:12.488982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:12.490582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:12.491741 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c9e692fb-6f08-43a9-8838-f80fc173f90d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1671 microversion: 2.20 time: 0.189854 Dec 24 05:09:12.492760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 621/1171] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:12 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:12.924803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:09:12.925436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:09:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:09:13.511848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:13.512479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:13.518869 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:13.519316 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:13.520092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:13.520518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:14.024213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:14.032733 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:14.034249 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:14.035408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2613e9e6-9bea-46de-a48a-fc314649c8d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.528250 Dec 24 05:09:14.035972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 551/1172] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:13 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:15.055399 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:15.056106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:15.062743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:15.063185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:15.063927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:15.064380 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:15.206523 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:15.217120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:15.218589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:15.219766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-337b8c25-7034-4d17-b571-58767f6c4f8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.168254 Dec 24 05:09:15.220317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 622/1173] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:15 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:16.237769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:16.238334 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:16.246140 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:16.246803 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:16.247607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:16.248036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:16.393316 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:16.401722 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:16.404056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:16.405320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.171410 Dec 24 05:09:16.405925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 552/1174] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:16 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:17.427888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:17.429428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:17.440107 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:17.440937 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:17.442228 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:17.442939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:17.574198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:09:17.574950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:09:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:09:17.587988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:17.598830 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:17.600316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:17.601494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.181151 Dec 24 05:09:17.602064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 623/1175] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:17 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:18.716545 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:18.717204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:18.726094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:18.726547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:18.727350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:18.727785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:18.866710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:18.875621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:18.877229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:18.878575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-16ef1bd2-27bb-453d-a63f-83818d5fff21 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.260636 Dec 24 05:09:18.887124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 553/1176] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:18 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:19.898192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:19.899110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:19.907131 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:19.907707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:19.909012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:19.909881 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:20.055250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:20.064426 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:20.065930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:20.067091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9c87aa52-011b-489c-9c97-1806f658e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.173699 Dec 24 05:09:20.079043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 624/1177] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:19 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:21.087510 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:21.088244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:21.094626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:21.095078 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:21.095862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:21.096290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:21.250315 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:21.259453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:21.260962 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:21.262131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8fb10cf1-c805-4e84-acbe-484c5158e070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.179335 Dec 24 05:09:21.262701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 554/1178] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:21 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:22.281373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:22.282077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:22.288898 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:22.289343 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:22.290141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:22.290572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:22.427274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:22.436984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:22.438454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:22.439610 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f70f6ba5-0e13-4668-b566-96de31f15fe7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.162441 Dec 24 05:09:22.440167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 625/1179] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:22 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:23.461940 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:23.462842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:23.469598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:23.470048 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:23.470845 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:23.471276 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:23.615857 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:23.623519 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:23.625009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:23.626177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fe30f7a5-63ea-4af5-9069-ba34d152958a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.168728 Dec 24 05:09:23.627035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 555/1180] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:23 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:24.656074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:24.656074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:24.659928 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:24.660367 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:24.661291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:24.661714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:24.804099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:24.812614 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:24.814203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:24.815393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d2453f9c-df7d-4bb2-bb61-7524a8df643b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.173956 Dec 24 05:09:24.815948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 626/1181] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:24 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:25.838629 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:25.839433 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:25.847854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:25.848807 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:25.849855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:25.850421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:25.983481 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:25.992173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:25.993831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:25.995012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d477490c-d5e9-409f-8ea3-14e1b6796f84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.161819 Dec 24 05:09:25.995565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 556/1182] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:25 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:27.018935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:27.019909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:27.030512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:27.031295 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:27.032594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:27.033273 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:27.171628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:27.180387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:27.181890 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:27.183047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-95c10f50-d48d-4775-8af0-863b69dc5659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.170406 Dec 24 05:09:27.183604 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 627/1183] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:27 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:28.202586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:28.203220 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:28.210252 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:28.210994 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:28.211759 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:28.212156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:28.357423 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:28.365550 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:28.367131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:28.368302 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6f5583b5-bc88-486c-b1e8-cad0efad4652 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.169724 Dec 24 05:09:28.368918 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 557/1184] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:28 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:29.386872 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:29.387503 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:29.396348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:29.396927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:29.397722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:29.398146 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:29.536503 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:29.544484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:29.546008 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:29.547144 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-dd102da7-574e-47e7-8dca-afa2ed1811d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.163972 Dec 24 05:09:29.547901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 628/1185] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:29 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:30.570746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:30.571435 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:30.578018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:30.578460 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:30.579225 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:30.579697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:30.723654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:30.731865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:30.733395 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:30.734533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.167561 Dec 24 05:09:30.735089 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 558/1186] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:30 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:31.752644 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:31.753270 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:31.759682 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:31.760730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:31.761509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:31.761930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:31.908216 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:31.916419 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:31.917919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:31.919068 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.170209 Dec 24 05:09:31.919622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 629/1187] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:31 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:32.937534 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:32.938193 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:32.944840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:32.945291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:32.946071 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:32.946497 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:33.024089 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-08032458-6253-4a52-97a7-9465120d7f14 req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:33.025718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:33.025718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:09:33.033259 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-08032458-6253-4a52-97a7-9465120d7f14 req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:33.035074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-08032458-6253-4a52-97a7-9465120d7f14 req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:33.052308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-08032458-6253-4a52-97a7-9465120d7f14 req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 service nova] Creating event network-vif-plugged:8f0b0287-0281-4556-ae15-8fe2c2dbf50d for instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 on hv-cinder-81644 Dec 24 05:09:33.057665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-08032458-6253-4a52-97a7-9465120d7f14 req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037781 Dec 24 05:09:33.058536 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 630/1188] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:33.087333 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:33.095946 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:33.097780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:33.098982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-29f4b241-7968-4645-bfad-0201a9a8e157 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.165203 Dec 24 05:09:33.099483 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 559/1189] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:32 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:34.120817 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:34.121581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:34.129782 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:34.130226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:34.131032 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:34.131458 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:34.275838 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:34.284510 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:34.286001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:34.287142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.172244 Dec 24 05:09:34.287702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 631/1190] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:34 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:35.305791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:35.306374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:35.313061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:35.313511 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:35.314296 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:35.314814 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:35.451312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:35.459829 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:35.461772 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:35.463004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7b65b785-6737-442c-a03a-8be87b515ed6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1729 microversion: 2.20 time: 0.161408 Dec 24 05:09:35.463622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 560/1191] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:35 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:09:35.609024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:35.609617 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:35.617339 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:35.617773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:35.618827 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:35.619249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:35.646544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:09:35.724519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 204 len: 0 microversion: 2.1 time: 0.119308 Dec 24 05:09:35.725145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 632/1192] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:09:35 2021] DELETE /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:09:35.733006 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:35.733651 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:35.740073 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:35.740559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:35.741323 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:35.741748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:35.881496 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:35.893840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-49091bfb-066c-4903-9766-84ce38727cc1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1577 microversion: 2.1 time: 0.164179 Dec 24 05:09:35.894734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 561/1193] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:35 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:36.485974 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:36.487112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:36.497662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:36.498395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:36.499664 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:36.500372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:36.635602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:36.644411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:36.645940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:36.647086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-06262651-12f0-4619-8f8d-f3ff1dc430ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1716 microversion: 2.20 time: 0.167967 Dec 24 05:09:36.647649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 633/1194] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:09:36 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:09:36.915571 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:36.916486 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:36.926532 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:36.927044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:36.927838 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:36.928260 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:37.079638 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:37.088162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cc4a1107-8f2b-4b72-9585-cacff4c0727a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1577 microversion: 2.1 time: 0.178995 Dec 24 05:09:37.088761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 562/1195] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:36 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:38.110233 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:38.110837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:38.117213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:38.117647 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:38.118421 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:38.118839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:38.253124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:38.261101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f34f63cf-13a3-4cda-b379-f63f0678c7af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1577 microversion: 2.1 time: 0.154572 Dec 24 05:09:38.261823 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 634/1196] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:38 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:38.711913 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-bc858dd5-a98a-4c34-8385-2977c3c7c344 req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "name": "network-vif-deleted", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:38.713552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:38.713552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:09:38.720926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-bc858dd5-a98a-4c34-8385-2977c3c7c344 req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:38.721361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-bc858dd5-a98a-4c34-8385-2977c3c7c344 req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:38.734479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-bc858dd5-a98a-4c34-8385-2977c3c7c344 req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a service nova] Creating event network-vif-deleted:f25ccd41-53b3-4bb9-84e1-824627c3e8e6 for instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 on hv-cinder-81644 Dec 24 05:09:38.739859 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-bc858dd5-a98a-4c34-8385-2977c3c7c344 req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031820 Dec 24 05:09:38.743402 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 563/1197] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:39.280781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:39.281332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:39.289475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:39.289952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:39.290795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:39.291215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:39.323959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:39.324404 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:39.324878 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lazy-loading 'fault' on Instance uuid d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:09:39.364336 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:39.372087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c588da71-8afa-4d90-94da-52d0b6b4311a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 200 len: 1231 microversion: 2.1 time: 0.097324 Dec 24 05:09:39.373095 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 635/1198] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:39 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:40.395274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:40.396418 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:40.406996 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:40.407725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:40.409053 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:40.409804 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:40.422936 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] HTTP exception thrown: Instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 could not be found. Dec 24 05:09:40.423513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Returning 404 to user: Instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:09:40.424322 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-69ff3056-da9e-46d3-9e01-0d754ce4d69a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 404 len: 111 microversion: 2.1 time: 0.036573 Dec 24 05:09:40.424956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 564/1199] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:40 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:09:40.473583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1790039159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1364510469", "security_groups": [{"name": "tempest-secgroup-smoke-2046201915"}], "block_device_mapping_v2": [{"uuid": "b047793d-9900-498a-8cda-2a295ad90c9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df2331c3-0dd0-460e-980f-1e2409baa35e"}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:40.585860 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] validate_networks() for [('df2331c3-0dd0-460e-980f-1e2409baa35e', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:09:41.027230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:09:41.027653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:09:41.028176 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:09:41.028683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:09:41.029094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:09:41.038956 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:41.039391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:41.040193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:41.040658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:41.057297 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:09:41.061223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for user 4039d5c6890448ee99194d769c5c387b and project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:09:41.117109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:09:41.119242 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b047793d-9900-498a-8cda-2a295ad90c9c',volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:09:41.264556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6f65114a-60ba-4f66-8254-488e97036ed9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794729 Dec 24 05:09:41.265198 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 636/1200] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:09:40 2021] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:09:41.275237 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-961fcb28-74d6-4d84-84be-18c0f5258ffa tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:41.275853 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-961fcb28-74d6-4d84-84be-18c0f5258ffa tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:41.329719 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-961fcb28-74d6-4d84-84be-18c0f5258ffa tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:41.336808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-961fcb28-74d6-4d84-84be-18c0f5258ffa tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1095 microversion: 2.1 time: 0.065193 Dec 24 05:09:41.337300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 565/1201] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:41 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:41.926245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:09:41.926877 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:09:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:09:42.104017 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1293532538"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:42.104988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:42.115316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:42.115760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:42.116573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:42.117012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:42.262968 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.network.security_group_api [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Removing security group bc3c93b3-eec1-4f52-a952-c229f892877e from port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f Dec 24 05:09:42.353784 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:42.354479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:42.361737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:42.362367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:42.363469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:42.363970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:42.455543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:42.463953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3b758615-b060-4278-a548-af417eb3797a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1201 microversion: 2.1 time: 0.114151 Dec 24 05:09:42.473731 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 566/1202] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:42 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1201 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:42.654285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/action" status: 202 len: 0 microversion: 2.1 time: 0.558360 Dec 24 05:09:42.654896 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 637/1203] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:09:42 2021] POST /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:09:42.669740 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-231756c8-bebd-4368-a774-04e7b2273d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:42.672247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:42.672247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:09:42.687606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-231756c8-bebd-4368-a774-04e7b2273d13 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:42.688350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-231756c8-bebd-4368-a774-04e7b2273d13 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:42.702120 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-231756c8-bebd-4368-a774-04e7b2273d13 service nova] Creating event network-changed:b8dc8fcb-f50d-49a3-9bd0-47110fdb068f for instance ae7a102d-4793-4384-bc31-07d28018c9df on hv-cinder-81644 Dec 24 05:09:42.710819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-231756c8-bebd-4368-a774-04e7b2273d13 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043606 Dec 24 05:09:42.712065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 567/1204] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:43.482583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:43.483157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:43.489371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:43.489794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:43.490599 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:43.491038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:43.762193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:43.770857 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae504dee-fcc1-4321-8223-9775fddbbe85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.293130 Dec 24 05:09:43.771436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 638/1205] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:43 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:43.936278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:43.937476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:43.943890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:43.944337 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:43.945160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:43.945592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:44.032947 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lazy-loading 'services' on Instance uuid ae7a102d-4793-4384-bc31-07d28018c9df {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:09:44.141822 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-20e3d1f4-b13c-4a06-90d2-83d7aefd3a1a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments/8b6290ee-cb02-404b-a693-7078c7a0692a" status: 202 len: 0 microversion: 2.1 time: 0.210079 Dec 24 05:09:44.142718 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 568/1206] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:09:43 2021] DELETE /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments/8b6290ee-cb02-404b-a693-7078c7a0692a => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:09:44.160696 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-582229c3-bed9-40d3-b61d-60ff6eaa861a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:44.164372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-582229c3-bed9-40d3-b61d-60ff6eaa861a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:44.183092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-582229c3-bed9-40d3-b61d-60ff6eaa861a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:44.183902 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-582229c3-bed9-40d3-b61d-60ff6eaa861a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:44.185013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-582229c3-bed9-40d3-b61d-60ff6eaa861a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:44.185668 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-582229c3-bed9-40d3-b61d-60ff6eaa861a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:44.250722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-582229c3-bed9-40d3-b61d-60ff6eaa861a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101703 Dec 24 05:09:44.254995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 639/1207] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:09:44 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:44.383211 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:44.385437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:44.385437 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:09:44.405332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:44.405788 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:44.429862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 service nova] Creating event network-changed:4f943d44-a70c-4b88-9cac-b16783cab1e5 for instance 067b7d98-4174-409c-85af-47a2dbf63a71 on hv-cinder-81644 Dec 24 05:09:44.438700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059973 Dec 24 05:09:44.439626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 569/1208] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:44.730127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-322e8b96-c04a-4770-993d-06c50ca29f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:44.732900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:44.732900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:09:44.741549 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-322e8b96-c04a-4770-993d-06c50ca29f26 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:44.742102 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-322e8b96-c04a-4770-993d-06c50ca29f26 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:44.754316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-322e8b96-c04a-4770-993d-06c50ca29f26 service nova] Creating event network-changed:b8dc8fcb-f50d-49a3-9bd0-47110fdb068f for instance ae7a102d-4793-4384-bc31-07d28018c9df on hv-cinder-81644 Dec 24 05:09:44.759907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-322e8b96-c04a-4770-993d-06c50ca29f26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Dec 24 05:09:44.760612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 640/1209] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:44.787901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:44.788614 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:44.795205 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:44.795642 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:44.796448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:44.796895 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:45.123140 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:45.132487 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-61ed0491-a1ce-4218-a02b-2beca4f49931 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.348818 Dec 24 05:09:45.133280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 570/1210] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:44 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:45.262824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b6a82bce-6f8a-4499-a720-811685bd7592 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:45.263921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b6a82bce-6f8a-4499-a720-811685bd7592 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:45.270501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6a82bce-6f8a-4499-a720-811685bd7592 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:45.270932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6a82bce-6f8a-4499-a720-811685bd7592 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:45.271702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6a82bce-6f8a-4499-a720-811685bd7592 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:45.272128 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b6a82bce-6f8a-4499-a720-811685bd7592 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:45.304250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b6a82bce-6f8a-4499-a720-811685bd7592 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045783 Dec 24 05:09:45.304881 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 641/1211] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:09:45 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:09:45.315578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:45.316160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:45.322486 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:45.322927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:45.323697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:45.324135 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:45.398880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] HTTP exception thrown: Instance ae7a102d-4793-4384-bc31-07d28018c9df is not attached to volume 8b6290ee-cb02-404b-a693-7078c7a0692a Dec 24 05:09:45.399473 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Returning 404 to user: Instance ae7a102d-4793-4384-bc31-07d28018c9df is not attached to volume 8b6290ee-cb02-404b-a693-7078c7a0692a {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:09:45.400305 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-491e1b24-b032-4136-89d9-2f62718495eb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments/8b6290ee-cb02-404b-a693-7078c7a0692a" status: 404 len: 154 microversion: 2.1 time: 0.088637 Dec 24 05:09:45.400911 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 571/1212] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:09:45 2021] DELETE /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df/os-volume_attachments/8b6290ee-cb02-404b-a693-7078c7a0692a => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:09:46.152846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:46.153469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:46.164666 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:46.164666 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:46.165169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:46.165589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:46.328483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:46.337118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1c82cd43-b78d-4766-ab88-fb0ac2351970 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.190188 Dec 24 05:09:46.337642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 642/1213] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:46 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:46.557247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:46.557780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:46.564754 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:46.565210 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:46.566014 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:46.566441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:46.593199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:09:46.673771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9e09df64-016c-46c0-afc6-a3a6940dd13d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 204 len: 0 microversion: 2.1 time: 0.119941 Dec 24 05:09:46.674441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 572/1214] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:09:46 2021] DELETE /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:09:46.683269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:46.683877 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:46.689686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:46.690124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:46.690930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:46.691357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:46.825532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:46.833952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1554 microversion: 2.1 time: 0.154363 Dec 24 05:09:46.834486 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 643/1215] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:46 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:47.355291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:47.355986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:47.362464 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:47.362909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:47.363684 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:47.364108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:47.503493 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:47.512266 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-93163977-691e-4fbe-baf6-18217ec44b89 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.160832 Dec 24 05:09:47.514311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 573/1216] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:47 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:47.854807 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:47.855427 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:47.865590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:47.866257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:47.867379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:47.868006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:48.009099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:48.019155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1554 microversion: 2.1 time: 0.170438 Dec 24 05:09:48.019964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 644/1217] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:47 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:48.534306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:48.534934 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:48.541748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:48.542192 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:48.542960 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:48.543382 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:48.695986 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:48.708047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1889e037-9edc-4b60-8c86-7602551ad12b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.177319 Dec 24 05:09:48.708944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 574/1218] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:48 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:49.036253 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:49.036927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:49.044192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:49.044669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:49.045451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:49.045885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:49.180074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd940f9211f415987d3443601acabc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:49.188130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 200 len: 1554 microversion: 2.1 time: 0.155396 Dec 24 05:09:49.198130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 645/1219] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:49 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:49.247966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-aec3c332-e6ad-4ec3-93fa-c0a8688cc8e8 req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "name": "network-vif-deleted", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:49.249803 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:49.249803 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:09:49.256787 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-aec3c332-e6ad-4ec3-93fa-c0a8688cc8e8 req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:49.257221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-aec3c332-e6ad-4ec3-93fa-c0a8688cc8e8 req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:49.268103 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-aec3c332-e6ad-4ec3-93fa-c0a8688cc8e8 req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 service nova] Creating event network-vif-deleted:b8dc8fcb-f50d-49a3-9bd0-47110fdb068f for instance ae7a102d-4793-4384-bc31-07d28018c9df on hv-cinder-81644 Dec 24 05:09:49.273411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-aec3c332-e6ad-4ec3-93fa-c0a8688cc8e8 req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030420 Dec 24 05:09:49.274127 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 575/1220] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:49.725755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:49.726514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:49.732964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:49.733933 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:49.734901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:49.735333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:49.867638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:49.874924 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9080efc0-4f11-4ab9-bed6-3492e07654fc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.153383 Dec 24 05:09:49.875485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 646/1221] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:49 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:50.211337 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:50.212190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] [instance: ae7a102d-4793-4384-bc31-07d28018c9df] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:50.225563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:50.226324 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:50.227615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:50.228332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:50.247096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] HTTP exception thrown: Instance ae7a102d-4793-4384-bc31-07d28018c9df could not be found. Dec 24 05:09:50.247677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Returning 404 to user: Instance ae7a102d-4793-4384-bc31-07d28018c9df could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:09:50.248499 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0cfce8ab-0647-4be3-9530-d889cdcc4d23 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df" status: 404 len: 111 microversion: 2.1 time: 0.045310 Dec 24 05:09:50.249073 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 576/1222] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:50 2021] GET /compute/v2.1/servers/ae7a102d-4793-4384-bc31-07d28018c9df => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:09:50.257469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9db3a612-4667-4453-8b6b-dd0690d2dc70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling method '.version_select at 0x7f7bae8d6160>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:50.283275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9db3a612-4667-4453-8b6b-dd0690d2dc70 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1181792733" status: 202 len: 0 microversion: 2.1 time: 0.029545 Dec 24 05:09:50.284038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 647/1223] 10.222.0.43 () {58 vars in 1271 bytes} [Fri Dec 24 05:09:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1181792733 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:09:50.891466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:50.892067 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:50.898946 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:50.899394 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:50.900153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:50.900598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:51.040919 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:51.048556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b06f60ce-916f-4448-a801-c40e6c2a6298 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.160917 Dec 24 05:09:51.049575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 577/1224] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:50 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:52.066373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:52.066985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:52.074676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:52.075909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:52.076874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:52.077264 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:52.305168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:52.313033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-370f1907-40fb-4541-9cf6-34556ef38780 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.250972 Dec 24 05:09:52.313833 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 648/1225] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:52 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:53.330872 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:53.331678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:53.338464 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:53.338909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:53.339682 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:53.340295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:53.488009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:53.495619 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-28b721b9-87a7-4585-9bba-768f1a9a3654 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.168596 Dec 24 05:09:53.496189 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 578/1226] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:53 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:54.512748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:54.513425 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:54.521338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:54.522211 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:54.522911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:54.523462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:54.686591 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:54.695133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bc797bfe-8850-45cd-8260-db6d044de98a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.186810 Dec 24 05:09:54.695723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 649/1227] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:54 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:55.126451 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-a701fd7e-dad0-4fb9-ad64-2aaf3b1e8120 req-c24e1241-9051-435a-9673-c4d27c49978b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "name": "network-vif-plugged", "status": "completed", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:09:55.129338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:55.129338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:09:55.139257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-a701fd7e-dad0-4fb9-ad64-2aaf3b1e8120 req-c24e1241-9051-435a-9673-c4d27c49978b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:55.139826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-a701fd7e-dad0-4fb9-ad64-2aaf3b1e8120 req-c24e1241-9051-435a-9673-c4d27c49978b service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:55.155572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-a701fd7e-dad0-4fb9-ad64-2aaf3b1e8120 req-c24e1241-9051-435a-9673-c4d27c49978b service nova] Creating event network-vif-plugged:4f943d44-a70c-4b88-9cac-b16783cab1e5 for instance 067b7d98-4174-409c-85af-47a2dbf63a71 on hv-cinder-81644 Dec 24 05:09:55.160883 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-a701fd7e-dad0-4fb9-ad64-2aaf3b1e8120 req-c24e1241-9051-435a-9673-c4d27c49978b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043306 Dec 24 05:09:55.161712 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 579/1228] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:09:55.713394 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:55.713955 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:55.720755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:55.721206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:55.721992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:55.722423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:55.880165 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:55.888025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.178898 Dec 24 05:09:55.888868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 650/1229] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:55 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:56.906636 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:56.907500 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:56.914586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:56.915484 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:56.917018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:56.917726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:57.082760 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:57.091198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a40955a6-7335-4fa2-9e8a-b60590977441 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1267 microversion: 2.1 time: 0.189211 Dec 24 05:09:57.092247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 580/1230] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:56 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:58.108069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:58.109377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:58.115947 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:58.116547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:58.117284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:58.117718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:58.259235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:58.266693 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1453 microversion: 2.1 time: 0.162273 Dec 24 05:09:58.267393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 651/1231] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:58 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:09:58.283605 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:09:58.284207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:09:58.291922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:58.292997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:58.292997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:09:58.293838 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:09:58.425098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:09:58.432826 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1453 microversion: 2.1 time: 0.152821 Dec 24 05:09:58.433391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 581/1232] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:09:58 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:00.341088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-81ba5042-5e86-4b51-b90b-2cd8a802a708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:10:00.341088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:10:00.341088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:10:00.347695 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-81ba5042-5e86-4b51-b90b-2cd8a802a708 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:00.348126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-81ba5042-5e86-4b51-b90b-2cd8a802a708 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:00.358935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-81ba5042-5e86-4b51-b90b-2cd8a802a708 service nova] Creating event network-changed:4f943d44-a70c-4b88-9cac-b16783cab1e5 for instance 067b7d98-4174-409c-85af-47a2dbf63a71 on hv-cinder-81644 Dec 24 05:10:00.364012 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-81ba5042-5e86-4b51-b90b-2cd8a802a708 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030148 Dec 24 05:10:00.364779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 652/1233] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:10:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:10:32.205880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-9072b3ea-e924-40a6-a408-95ae8a4af005 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:32.206780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-9072b3ea-e924-40a6-a408-95ae8a4af005 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:32.213691 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9072b3ea-e924-40a6-a408-95ae8a4af005 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:32.214136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9072b3ea-e924-40a6-a408-95ae8a4af005 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:32.214897 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9072b3ea-e924-40a6-a408-95ae8a4af005 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:32.215316 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-9072b3ea-e924-40a6-a408-95ae8a4af005 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:32.244716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-9072b3ea-e924-40a6-a408-95ae8a4af005 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043045 Dec 24 05:10:32.245270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 582/1234] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Dec 24 05:10:32 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:32.315027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:32.315913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:32.325814 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:32.326540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:32.327737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:32.328274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:32.355263 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:10:32.440790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 204 len: 0 microversion: 2.20 time: 0.131072 Dec 24 05:10:32.441769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 653/1235] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Dec 24 05:10:32 2021] DELETE /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 05:10:32.450199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:32.450840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:32.457090 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:32.457529 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:32.458291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:32.458932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:32.592785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:32.601567 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:32.603049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:32.604232 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.157845 Dec 24 05:10:32.604815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 583/1236] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:10:32 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 24 05:10:33.632602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:33.633201 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:33.640361 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:33.640860 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:33.641662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:33.642129 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:33.799453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:33.808910 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:33.810398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:33.811557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0044af07-9a38-41dc-8321-13bc812aef60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1722 microversion: 2.20 time: 0.185753 Dec 24 05:10:33.812127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 654/1237] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:10:33 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:10:34.830345 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:34.831041 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:34.838438 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:34.839567 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:34.840357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:34.840812 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:34.906623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:34.915025 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:34.916510 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979cc4a0723b4543a16197d393c7929a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:34.917701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e8a62533-23b1-4b16-adbf-44b1ed9d705c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 200 len: 1655 microversion: 2.20 time: 0.091182 Dec 24 05:10:34.918266 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 584/1238] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:10:34 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 24 05:10:35.323291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-56ec562b-f2bb-428e-8562-ab0a1dd6c371 req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-deleted", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:10:35.325009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:10:35.325009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:10:35.331834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-56ec562b-f2bb-428e-8562-ab0a1dd6c371 req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:35.332307 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-56ec562b-f2bb-428e-8562-ab0a1dd6c371 req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:35.343646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-56ec562b-f2bb-428e-8562-ab0a1dd6c371 req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 service nova] Creating event network-vif-deleted:8f0b0287-0281-4556-ae15-8fe2c2dbf50d for instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 on hv-cinder-81644 Dec 24 05:10:35.348347 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-56ec562b-f2bb-428e-8562-ab0a1dd6c371 req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250370 Dec 24 05:10:35.349040 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 655/1239] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:10:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:10:35.936124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:35.937075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:35.944279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:35.945037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:35.946080 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:35.946543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:35.961828 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] HTTP exception thrown: Instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 could not be found. Dec 24 05:10:35.962421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Returning 404 to user: Instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:10:35.963262 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-358c3b26-a4d4-4185-8187-3ce480bc52b3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 404 len: 111 microversion: 2.20 time: 0.031108 Dec 24 05:10:35.963793 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 585/1240] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:10:35 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 05:10:35.972968 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-800165e4-0fc5-482c-b047-82ddf2486429 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '.version_select at 0x7f7bae88e430>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:35.997680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-800165e4-0fc5-482c-b047-82ddf2486429 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780678015" status: 204 len: 0 microversion: 2.20 time: 0.028752 Dec 24 05:10:35.998380 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 656/1241] 10.222.0.43 () {60 vars in 1258 bytes} [Fri Dec 24 05:10:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780678015 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 24 05:10:37.806854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:37.807399 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:37.814152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:37.814591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:37.815365 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:37.815787 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:37.829563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] HTTP exception thrown: Instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 could not be found. Dec 24 05:10:37.830141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Returning 404 to user: Instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:10:37.830956 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4a934f2d-a84b-4cdb-95db-3efc0ec12e22 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 404 len: 111 microversion: 2.20 time: 0.028242 Dec 24 05:10:37.831487 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 586/1242] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Dec 24 05:10:37 2021] DELETE /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 05:10:37.840508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:37.841270 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: cc21b91f-c07f-40f8-8cf1-a9c343386f03] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:37.847534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:37.847972 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:37.848779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:37.849205 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:37.862324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] HTTP exception thrown: Instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 could not be found. Dec 24 05:10:37.862894 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Returning 404 to user: Instance cc21b91f-c07f-40f8-8cf1-a9c343386f03 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:10:37.863694 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-12a373ab-943e-41c4-9baf-5247ed80954f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03" status: 404 len: 111 microversion: 2.20 time: 0.027491 Dec 24 05:10:37.864194 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 657/1243] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:10:37 2021] GET /compute/v2.1/servers/cc21b91f-c07f-40f8-8cf1-a9c343386f03 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 24 05:10:38.995164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:38.995688 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:39.002714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:39.003156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:39.003931 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:39.004352 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:39.018633 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] HTTP exception thrown: Instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 could not be found. Dec 24 05:10:39.019207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Returning 404 to user: Instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:10:39.020031 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-cbf17650-3381-4d62-9734-dd835505d426 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 404 len: 111 microversion: 2.20 time: 0.028935 Dec 24 05:10:39.020575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 587/1244] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Dec 24 05:10:38 2021] DELETE /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 05:10:39.028750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:39.029367 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] [instance: 6485c286-d5e3-42e7-bf58-c4685f8c3066] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:39.036263 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:39.036743 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:39.037525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:39.037959 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:39.051118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] HTTP exception thrown: Instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 could not be found. Dec 24 05:10:39.051699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Returning 404 to user: Instance 6485c286-d5e3-42e7-bf58-c4685f8c3066 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:10:39.052514 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d5175525-d290-4b12-87dc-ae1744f49730 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066" status: 404 len: 111 microversion: 2.20 time: 0.027549 Dec 24 05:10:39.053064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 658/1245] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Dec 24 05:10:39 2021] GET /compute/v2.1/servers/6485c286-d5e3-42e7-bf58-c4685f8c3066 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 24 05:10:47.780921 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0792743b-8387-45a6-b66f-3997846256a8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'create', calling method: .version_select at 0x7f7baded7670>, body: {"keypair": {"name": "tempest-keypair-1006078588"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:10:47.795135 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-0792743b-8387-45a6-b66f-3997846256a8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:10:47.799018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-0792743b-8387-45a6-b66f-3997846256a8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for user bccbafbbab7e4c358b444e4efc684a01 and project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:10:48.113781 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-0792743b-8387-45a6-b66f-3997846256a8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:10:48.117872 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-0792743b-8387-45a6-b66f-3997846256a8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for user bccbafbbab7e4c358b444e4efc684a01 and project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:10:48.131449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0792743b-8387-45a6-b66f-3997846256a8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.472711 Dec 24 05:10:48.131876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 588/1246] 10.222.0.43 () {60 vars in 1157 bytes} [Fri Dec 24 05:10:47 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:10:49.464885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-469834370", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "075b69cb-c546-4fa5-aa29-49a5b85c94b1"}], "security_groups": [{"name": "tempest-securitygroup--457847245"}], "key_name": "tempest-keypair-1006078588", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:10:49.593746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] validate_networks() for [('075b69cb-c546-4fa5-aa29-49a5b85c94b1', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:10:49.979438 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:10:49.979932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:10:49.980658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:10:49.981118 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:10:49.981598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:10:49.991050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:49.991571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:49.992520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:49.993099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:50.016839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:10:50.029489 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for user bccbafbbab7e4c358b444e4efc684a01 and project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:10:50.044993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:10:50.048345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:10:50.111739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-012c984a-ba2b-44bc-a025-bf9bd5cc59da tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.652077 Dec 24 05:10:50.113982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 659/1247] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:10:49 2021] POST /compute/v2.1/servers => generated 401 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 24 05:10:50.123409 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-340acbef-6d7e-4f5c-b532-0e6a7850ccd3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:50.124682 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-340acbef-6d7e-4f5c-b532-0e6a7850ccd3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:50.204316 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-340acbef-6d7e-4f5c-b532-0e6a7850ccd3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:50.212776 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-340acbef-6d7e-4f5c-b532-0e6a7850ccd3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1237 microversion: 2.1 time: 0.093044 Dec 24 05:10:50.213981 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 589/1248] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:50 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:51.230598 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:51.231345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:51.237667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:51.238126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:51.238908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:51.239330 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:51.300518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:51.308547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f4a02ec6-19df-45c2-b837-de669ece0101 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1307 microversion: 2.1 time: 0.082182 Dec 24 05:10:51.309512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 660/1249] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:51 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:52.326319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:52.326927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:52.333310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:52.333751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:52.334515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:52.335294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:52.570535 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:52.578050 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.255430 Dec 24 05:10:52.578612 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 590/1250] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:52 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:52.659814 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-9a392ffd-6487-4292-a7ed-98938cbe73e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:10:52.661853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:10:52.661853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:10:52.670286 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-9a392ffd-6487-4292-a7ed-98938cbe73e4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:52.671055 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-9a392ffd-6487-4292-a7ed-98938cbe73e4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:52.690294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-9a392ffd-6487-4292-a7ed-98938cbe73e4 service nova] Creating event network-changed:b3526449-31e3-4b8f-a3a1-329333c58c47 for instance 5096ad5d-d707-4082-908c-d12a3d5519cc on hv-cinder-81644 Dec 24 05:10:52.696808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-9a392ffd-6487-4292-a7ed-98938cbe73e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040512 Dec 24 05:10:52.697481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 661/1251] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:10:53.595458 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:53.596088 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:53.602902 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:53.603351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:53.604122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:53.604610 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:53.802181 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:53.811272 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.219340 Dec 24 05:10:53.812054 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 591/1252] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:53 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:54.835294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:54.836189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:54.844312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:54.845500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:54.845667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:54.846086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:55.006590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:55.015649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-adb060ca-686b-4389-9aa7-3f3ff35c7887 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.184961 Dec 24 05:10:55.016351 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 662/1253] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:54 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:56.032711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:56.033310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:56.039815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:56.040261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:56.041083 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:56.041515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:56.178708 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:56.186208 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.157373 Dec 24 05:10:56.186767 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 592/1254] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:56 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:57.212506 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:57.213977 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:57.224646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:57.225421 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:57.226793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:57.227546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:57.363154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:57.370945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6c2284b5-068c-4563-97c6-13bca17fb68f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.170358 Dec 24 05:10:57.371826 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 663/1255] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:57 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:58.390450 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:58.391207 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:58.399566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:58.400135 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:58.401141 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:58.401679 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:58.541804 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:58.550014 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-305f2a59-1523-4e5e-b592-65673674dd24 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.165184 Dec 24 05:10:58.550577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 593/1256] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:58 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:10:59.416794 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-be97e12e-cd8b-447e-8cf4-e3333e256558 req-12db9350-6a2a-411b-aeb9-82599bf3df1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "name": "network-vif-plugged", "status": "completed", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:10:59.418483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:10:59.418483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:10:59.427750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-be97e12e-cd8b-447e-8cf4-e3333e256558 req-12db9350-6a2a-411b-aeb9-82599bf3df1c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:59.428387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-be97e12e-cd8b-447e-8cf4-e3333e256558 req-12db9350-6a2a-411b-aeb9-82599bf3df1c service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:59.440864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-be97e12e-cd8b-447e-8cf4-e3333e256558 req-12db9350-6a2a-411b-aeb9-82599bf3df1c service nova] Creating event network-vif-plugged:b3526449-31e3-4b8f-a3a1-329333c58c47 for instance 5096ad5d-d707-4082-908c-d12a3d5519cc on hv-cinder-81644 Dec 24 05:10:59.445876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-be97e12e-cd8b-447e-8cf4-e3333e256558 req-12db9350-6a2a-411b-aeb9-82599bf3df1c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095927 Dec 24 05:10:59.446415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 664/1257] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:10:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:10:59.567906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:10:59.568582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:10:59.575917 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:59.576369 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:59.577278 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:10:59.577716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:10:59.763033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:10:59.771194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d8123412-2587-4659-a205-4b9d6bd00f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.207425 Dec 24 05:10:59.771765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 594/1258] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:10:59 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:11:00.792602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:11:00.793872 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:00.801132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:00.801579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:00.802358 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:00.802795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:00.940357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:11:00.948280 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1362 microversion: 2.1 time: 0.163189 Dec 24 05:11:00.948879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 665/1259] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:11:00 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:11:01.968035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:11:01.968654 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:01.975465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:01.975917 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:01.976745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:01.977184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:02.111680 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:11:02.119765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2543757f-3f54-46c4-9dd3-a955f61ac8fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1549 microversion: 2.1 time: 0.156718 Dec 24 05:11:02.120327 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 595/1260] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:11:01 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:11:02.137721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e8668788-6532-4d21-8d89-f10cd10b425a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:11:02.138410 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e8668788-6532-4d21-8d89-f10cd10b425a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:02.145136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8668788-6532-4d21-8d89-f10cd10b425a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:02.145582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8668788-6532-4d21-8d89-f10cd10b425a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:02.146384 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8668788-6532-4d21-8d89-f10cd10b425a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:02.146813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e8668788-6532-4d21-8d89-f10cd10b425a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:02.229039 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e8668788-6532-4d21-8d89-f10cd10b425a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096151 Dec 24 05:11:02.229662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 666/1261] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Dec 24 05:11:02 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:11:03.450701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-75c0c67d-7da7-4cdb-9d49-63cfbb903db6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:03.451937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-75c0c67d-7da7-4cdb-9d49-63cfbb903db6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:03.452999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-8b4e279d-0234-456d-bf69-729598d83e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:03.455114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:11:03.455114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:11:03.459200 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75c0c67d-7da7-4cdb-9d49-63cfbb903db6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:03.459725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75c0c67d-7da7-4cdb-9d49-63cfbb903db6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:03.461021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75c0c67d-7da7-4cdb-9d49-63cfbb903db6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:03.461528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-75c0c67d-7da7-4cdb-9d49-63cfbb903db6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:03.462345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-8b4e279d-0234-456d-bf69-729598d83e04 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:03.462790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-8b4e279d-0234-456d-bf69-729598d83e04 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:03.476729 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-8b4e279d-0234-456d-bf69-729598d83e04 service nova] Creating event network-changed:b3526449-31e3-4b8f-a3a1-329333c58c47 for instance 5096ad5d-d707-4082-908c-d12a3d5519cc on hv-cinder-81644 Dec 24 05:11:03.481965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-8b4e279d-0234-456d-bf69-729598d83e04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032769 Dec 24 05:11:03.482689 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 667/1262] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:11:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:11:03.574467 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-75c0c67d-7da7-4cdb-9d49-63cfbb903db6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.127434 Dec 24 05:11:03.577924 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 596/1263] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:03 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:04.586509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e1941198-04a7-4973-b3ac-fd1afeead72f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:04.587512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e1941198-04a7-4973-b3ac-fd1afeead72f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:04.595105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1941198-04a7-4973-b3ac-fd1afeead72f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:04.595541 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1941198-04a7-4973-b3ac-fd1afeead72f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:04.596332 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1941198-04a7-4973-b3ac-fd1afeead72f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:04.596795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1941198-04a7-4973-b3ac-fd1afeead72f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:04.681581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e1941198-04a7-4973-b3ac-fd1afeead72f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.099326 Dec 24 05:11:04.682225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 668/1264] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:04 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:05.697718 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-019eceae-695c-4e55-875b-684c83d455de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:05.699193 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-019eceae-695c-4e55-875b-684c83d455de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:05.711446 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-019eceae-695c-4e55-875b-684c83d455de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:05.712179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-019eceae-695c-4e55-875b-684c83d455de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:05.713499 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-019eceae-695c-4e55-875b-684c83d455de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:05.714218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-019eceae-695c-4e55-875b-684c83d455de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:05.802819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-019eceae-695c-4e55-875b-684c83d455de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.111572 Dec 24 05:11:05.803785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 597/1265] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:05 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:06.821585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1986acfc-5121-461f-8ccc-a6f4e9777889 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:06.823225 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1986acfc-5121-461f-8ccc-a6f4e9777889 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:06.831417 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1986acfc-5121-461f-8ccc-a6f4e9777889 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:06.832009 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1986acfc-5121-461f-8ccc-a6f4e9777889 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:06.832813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1986acfc-5121-461f-8ccc-a6f4e9777889 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:06.833234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1986acfc-5121-461f-8ccc-a6f4e9777889 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:06.916190 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1986acfc-5121-461f-8ccc-a6f4e9777889 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.100814 Dec 24 05:11:06.917218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 669/1266] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:06 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:07.930583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4b0a420b-6e8c-4552-9e0e-1d890576d7fc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:07.931628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4b0a420b-6e8c-4552-9e0e-1d890576d7fc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:07.939094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4b0a420b-6e8c-4552-9e0e-1d890576d7fc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:07.939537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4b0a420b-6e8c-4552-9e0e-1d890576d7fc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:07.940311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4b0a420b-6e8c-4552-9e0e-1d890576d7fc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:07.940777 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4b0a420b-6e8c-4552-9e0e-1d890576d7fc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:08.025989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4b0a420b-6e8c-4552-9e0e-1d890576d7fc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.098975 Dec 24 05:11:08.026959 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 598/1267] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:07 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:09.044325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f577b01-d174-4a33-a657-3c6f8149979d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:09.046033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f577b01-d174-4a33-a657-3c6f8149979d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:09.053913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f577b01-d174-4a33-a657-3c6f8149979d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:09.054363 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f577b01-d174-4a33-a657-3c6f8149979d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:09.055139 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f577b01-d174-4a33-a657-3c6f8149979d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:09.055572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f577b01-d174-4a33-a657-3c6f8149979d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:09.138888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f577b01-d174-4a33-a657-3c6f8149979d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.100871 Dec 24 05:11:09.139862 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 670/1268] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:09 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:10.156920 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-77712e4d-12b9-4e3a-b3a9-c8cb9ce4aa0e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:10.157846 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-77712e4d-12b9-4e3a-b3a9-c8cb9ce4aa0e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:10.165226 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77712e4d-12b9-4e3a-b3a9-c8cb9ce4aa0e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:10.165699 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77712e4d-12b9-4e3a-b3a9-c8cb9ce4aa0e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:10.166463 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77712e4d-12b9-4e3a-b3a9-c8cb9ce4aa0e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:10.166889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-77712e4d-12b9-4e3a-b3a9-c8cb9ce4aa0e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:10.258338 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-77712e4d-12b9-4e3a-b3a9-c8cb9ce4aa0e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.107895 Dec 24 05:11:10.258976 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 599/1269] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:10 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:11.270256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-63ebc39d-7370-492c-9ec3-9c1d55d4fda8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:11.271279 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-63ebc39d-7370-492c-9ec3-9c1d55d4fda8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:11.278737 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63ebc39d-7370-492c-9ec3-9c1d55d4fda8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:11.279150 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63ebc39d-7370-492c-9ec3-9c1d55d4fda8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:11.279914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63ebc39d-7370-492c-9ec3-9c1d55d4fda8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:11.280334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-63ebc39d-7370-492c-9ec3-9c1d55d4fda8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:11.366961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-63ebc39d-7370-492c-9ec3-9c1d55d4fda8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.100704 Dec 24 05:11:11.367582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 671/1270] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:11 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:12.380455 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-53ff593a-dea8-4c0d-aa0b-5e57c8134c7f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:12.382006 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-53ff593a-dea8-4c0d-aa0b-5e57c8134c7f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:12.392439 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53ff593a-dea8-4c0d-aa0b-5e57c8134c7f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:12.393153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53ff593a-dea8-4c0d-aa0b-5e57c8134c7f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:12.394321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53ff593a-dea8-4c0d-aa0b-5e57c8134c7f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:12.394961 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-53ff593a-dea8-4c0d-aa0b-5e57c8134c7f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:12.483143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-53ff593a-dea8-4c0d-aa0b-5e57c8134c7f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 14 microversion: 2.1 time: 0.108309 Dec 24 05:11:12.483775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 600/1271] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:12 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:11:13.499252 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d35aee9a-9eaa-4158-8a1f-30877fb0c2b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:13.501040 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d35aee9a-9eaa-4158-8a1f-30877fb0c2b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:13.512318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d35aee9a-9eaa-4158-8a1f-30877fb0c2b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:13.513105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d35aee9a-9eaa-4158-8a1f-30877fb0c2b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:13.514373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d35aee9a-9eaa-4158-8a1f-30877fb0c2b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:13.515081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d35aee9a-9eaa-4158-8a1f-30877fb0c2b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:13.614511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d35aee9a-9eaa-4158-8a1f-30877fb0c2b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 7543 microversion: 2.1 time: 0.121392 Dec 24 05:11:13.615387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 672/1272] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:13 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 7543 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:11:14.633244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1aa848c8-2661-439c-9461-5ceaee139a26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:14.634730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1aa848c8-2661-439c-9461-5ceaee139a26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:14.646813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1aa848c8-2661-439c-9461-5ceaee139a26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:14.647546 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1aa848c8-2661-439c-9461-5ceaee139a26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:14.648905 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1aa848c8-2661-439c-9461-5ceaee139a26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:14.649625 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1aa848c8-2661-439c-9461-5ceaee139a26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:14.746653 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1aa848c8-2661-439c-9461-5ceaee139a26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 16191 microversion: 2.1 time: 0.120479 Dec 24 05:11:14.747317 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 601/1273] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:14 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 16191 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:15.762791 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a2a578a8-96b7-468c-bbaf-7beca8dd1a60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:15.764050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a2a578a8-96b7-468c-bbaf-7beca8dd1a60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:15.772423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2a578a8-96b7-468c-bbaf-7beca8dd1a60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:15.772915 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2a578a8-96b7-468c-bbaf-7beca8dd1a60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:15.773721 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2a578a8-96b7-468c-bbaf-7beca8dd1a60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:15.774166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2a578a8-96b7-468c-bbaf-7beca8dd1a60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:15.873185 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a2a578a8-96b7-468c-bbaf-7beca8dd1a60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 18561 microversion: 2.1 time: 0.116697 Dec 24 05:11:15.874534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 673/1274] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:15 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 18561 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:16.891161 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4a3686ec-ebc1-43b0-b121-7c836ab6de57 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:16.892895 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4a3686ec-ebc1-43b0-b121-7c836ab6de57 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:16.904385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a3686ec-ebc1-43b0-b121-7c836ab6de57 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:16.905194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a3686ec-ebc1-43b0-b121-7c836ab6de57 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:16.906616 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a3686ec-ebc1-43b0-b121-7c836ab6de57 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:16.907049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4a3686ec-ebc1-43b0-b121-7c836ab6de57 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:17.002707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4a3686ec-ebc1-43b0-b121-7c836ab6de57 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 20997 microversion: 2.1 time: 0.117839 Dec 24 05:11:17.003707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 602/1275] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:16 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 20997 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:18.019536 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ce764af0-2cd0-4e5c-8988-2683b8a11693 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:18.020674 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ce764af0-2cd0-4e5c-8988-2683b8a11693 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:18.028638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce764af0-2cd0-4e5c-8988-2683b8a11693 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:18.029137 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce764af0-2cd0-4e5c-8988-2683b8a11693 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:18.029998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce764af0-2cd0-4e5c-8988-2683b8a11693 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:18.030475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ce764af0-2cd0-4e5c-8988-2683b8a11693 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:18.124769 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ce764af0-2cd0-4e5c-8988-2683b8a11693 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 22981 microversion: 2.1 time: 0.110550 Dec 24 05:11:18.125592 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 674/1276] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:18 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 22981 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:19.142655 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bf685a98-0e54-44c4-8323-39ac0f79a0c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:19.144275 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bf685a98-0e54-44c4-8323-39ac0f79a0c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:19.155728 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf685a98-0e54-44c4-8323-39ac0f79a0c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:19.156555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf685a98-0e54-44c4-8323-39ac0f79a0c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:19.157329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf685a98-0e54-44c4-8323-39ac0f79a0c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:19.157755 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bf685a98-0e54-44c4-8323-39ac0f79a0c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:19.253203 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bf685a98-0e54-44c4-8323-39ac0f79a0c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 24339 microversion: 2.1 time: 0.116761 Dec 24 05:11:19.254229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 603/1277] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:19 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 24339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:20.269782 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4e789714-2a98-4bfd-bd42-cb49acd423fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:20.270684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4e789714-2a98-4bfd-bd42-cb49acd423fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:20.277924 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e789714-2a98-4bfd-bd42-cb49acd423fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:20.278375 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e789714-2a98-4bfd-bd42-cb49acd423fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:20.279150 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e789714-2a98-4bfd-bd42-cb49acd423fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:20.279574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4e789714-2a98-4bfd-bd42-cb49acd423fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:20.370222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4e789714-2a98-4bfd-bd42-cb49acd423fd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 26019 microversion: 2.1 time: 0.105519 Dec 24 05:11:20.370865 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 675/1278] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:20 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 26019 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:21.388306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8427da7e-77e0-458c-bcb3-16b86c8102d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:21.389963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8427da7e-77e0-458c-bcb3-16b86c8102d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:21.401746 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8427da7e-77e0-458c-bcb3-16b86c8102d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:21.402485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8427da7e-77e0-458c-bcb3-16b86c8102d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:21.403761 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8427da7e-77e0-458c-bcb3-16b86c8102d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:21.404468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8427da7e-77e0-458c-bcb3-16b86c8102d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:21.518580 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8427da7e-77e0-458c-bcb3-16b86c8102d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 27250 microversion: 2.1 time: 0.136624 Dec 24 05:11:21.519540 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 604/1279] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:21 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 27250 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:22.537091 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-394f5645-1364-4bf1-8fbd-8deaedef1ad4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:22.538195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-394f5645-1364-4bf1-8fbd-8deaedef1ad4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:22.546099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394f5645-1364-4bf1-8fbd-8deaedef1ad4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:22.546589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394f5645-1364-4bf1-8fbd-8deaedef1ad4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:22.547449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394f5645-1364-4bf1-8fbd-8deaedef1ad4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:22.547918 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-394f5645-1364-4bf1-8fbd-8deaedef1ad4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:22.649482 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-394f5645-1364-4bf1-8fbd-8deaedef1ad4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 27743 microversion: 2.1 time: 0.118747 Dec 24 05:11:22.650370 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 676/1280] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:22 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 27743 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:23.668457 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-82c91ba4-428b-4efb-87f7-1cb75733126f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:23.670100 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-82c91ba4-428b-4efb-87f7-1cb75733126f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:23.679908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82c91ba4-428b-4efb-87f7-1cb75733126f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:23.680346 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82c91ba4-428b-4efb-87f7-1cb75733126f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:23.681156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82c91ba4-428b-4efb-87f7-1cb75733126f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:23.681608 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-82c91ba4-428b-4efb-87f7-1cb75733126f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:23.776132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-82c91ba4-428b-4efb-87f7-1cb75733126f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.114231 Dec 24 05:11:23.777214 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 605/1281] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:23 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:24.796238 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-94f27891-dd14-4e35-9145-c1b828b62dc5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:24.797949 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-94f27891-dd14-4e35-9145-c1b828b62dc5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:24.809618 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94f27891-dd14-4e35-9145-c1b828b62dc5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:24.810350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94f27891-dd14-4e35-9145-c1b828b62dc5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:24.811652 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94f27891-dd14-4e35-9145-c1b828b62dc5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:24.812356 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-94f27891-dd14-4e35-9145-c1b828b62dc5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:24.901963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-94f27891-dd14-4e35-9145-c1b828b62dc5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.111987 Dec 24 05:11:24.903157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 677/1282] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:24 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:25.921306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e6030ba4-faa8-49be-80ef-fddb6315ac11 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:25.922914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e6030ba4-faa8-49be-80ef-fddb6315ac11 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:25.932209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e6030ba4-faa8-49be-80ef-fddb6315ac11 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:25.932683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e6030ba4-faa8-49be-80ef-fddb6315ac11 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:25.933448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e6030ba4-faa8-49be-80ef-fddb6315ac11 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:25.933872 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e6030ba4-faa8-49be-80ef-fddb6315ac11 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:26.019479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e6030ba4-faa8-49be-80ef-fddb6315ac11 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.104546 Dec 24 05:11:26.020556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 606/1283] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:25 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:27.037754 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fe42435b-5795-4b0f-8a22-682ebfbb753f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:27.038767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fe42435b-5795-4b0f-8a22-682ebfbb753f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:27.046021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe42435b-5795-4b0f-8a22-682ebfbb753f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:27.046497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe42435b-5795-4b0f-8a22-682ebfbb753f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:27.047283 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe42435b-5795-4b0f-8a22-682ebfbb753f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:27.047713 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fe42435b-5795-4b0f-8a22-682ebfbb753f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:27.136485 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fe42435b-5795-4b0f-8a22-682ebfbb753f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.104587 Dec 24 05:11:27.137564 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 678/1284] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:27 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:28.156299 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c8a93f2b-0586-42c3-afa9-c263c466117b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:28.158526 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c8a93f2b-0586-42c3-afa9-c263c466117b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:28.170355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a93f2b-0586-42c3-afa9-c263c466117b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:28.171118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a93f2b-0586-42c3-afa9-c263c466117b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:28.172614 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a93f2b-0586-42c3-afa9-c263c466117b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:28.173643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8a93f2b-0586-42c3-afa9-c263c466117b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:28.269920 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c8a93f2b-0586-42c3-afa9-c263c466117b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.120890 Dec 24 05:11:28.270854 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 607/1285] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:28 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:29.291596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-36e451e9-965f-4f4f-bc1d-896f1b7993e3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:29.293052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-36e451e9-965f-4f4f-bc1d-896f1b7993e3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:29.304408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e451e9-965f-4f4f-bc1d-896f1b7993e3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:29.305196 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e451e9-965f-4f4f-bc1d-896f1b7993e3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:29.306439 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e451e9-965f-4f4f-bc1d-896f1b7993e3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:29.307081 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-36e451e9-965f-4f4f-bc1d-896f1b7993e3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:29.398501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-36e451e9-965f-4f4f-bc1d-896f1b7993e3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.117096 Dec 24 05:11:29.399395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 679/1286] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:29 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:30.414420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-81fbae67-f6c2-4433-83d1-988aca895680 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:30.415675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-81fbae67-f6c2-4433-83d1-988aca895680 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:30.426743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81fbae67-f6c2-4433-83d1-988aca895680 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:30.427489 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81fbae67-f6c2-4433-83d1-988aca895680 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:30.428659 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81fbae67-f6c2-4433-83d1-988aca895680 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:30.429092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-81fbae67-f6c2-4433-83d1-988aca895680 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:30.515566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-81fbae67-f6c2-4433-83d1-988aca895680 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.106941 Dec 24 05:11:30.516202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 608/1287] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:30 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:31.527476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-285c797b-f5db-4eb9-aa41-abadbe10df05 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:31.528481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-285c797b-f5db-4eb9-aa41-abadbe10df05 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:31.535653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-285c797b-f5db-4eb9-aa41-abadbe10df05 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:31.536098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-285c797b-f5db-4eb9-aa41-abadbe10df05 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:31.536911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-285c797b-f5db-4eb9-aa41-abadbe10df05 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:31.537557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-285c797b-f5db-4eb9-aa41-abadbe10df05 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:31.637156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-285c797b-f5db-4eb9-aa41-abadbe10df05 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.113374 Dec 24 05:11:31.637767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 680/1288] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:31 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:32.653433 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-935513a9-0a1e-4fa1-a866-1c92b36ea31e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:32.654387 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-935513a9-0a1e-4fa1-a866-1c92b36ea31e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:32.661983 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-935513a9-0a1e-4fa1-a866-1c92b36ea31e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:32.662450 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-935513a9-0a1e-4fa1-a866-1c92b36ea31e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:32.663263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-935513a9-0a1e-4fa1-a866-1c92b36ea31e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:32.663710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-935513a9-0a1e-4fa1-a866-1c92b36ea31e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:32.755893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-935513a9-0a1e-4fa1-a866-1c92b36ea31e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.108109 Dec 24 05:11:32.756970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 609/1289] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:32 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:33.771032 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2ea4d7a2-7975-4f54-b674-20923f8c646d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:33.772038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2ea4d7a2-7975-4f54-b674-20923f8c646d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:33.779728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ea4d7a2-7975-4f54-b674-20923f8c646d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:33.780169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ea4d7a2-7975-4f54-b674-20923f8c646d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:33.781393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ea4d7a2-7975-4f54-b674-20923f8c646d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:33.781854 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2ea4d7a2-7975-4f54-b674-20923f8c646d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:33.871061 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2ea4d7a2-7975-4f54-b674-20923f8c646d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.104366 Dec 24 05:11:33.871732 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 681/1290] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:33 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:34.888501 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e534fbc6-ef01-4c97-97f4-9034c9babcf6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:34.890164 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e534fbc6-ef01-4c97-97f4-9034c9babcf6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:34.901521 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e534fbc6-ef01-4c97-97f4-9034c9babcf6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:34.901965 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e534fbc6-ef01-4c97-97f4-9034c9babcf6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:34.902745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e534fbc6-ef01-4c97-97f4-9034c9babcf6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:34.903175 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e534fbc6-ef01-4c97-97f4-9034c9babcf6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:34.986624 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e534fbc6-ef01-4c97-97f4-9034c9babcf6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28187 microversion: 2.1 time: 0.105392 Dec 24 05:11:34.987259 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 610/1291] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:34 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:36.003453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2830b257-6617-494e-af04-2ad43c645b0c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:36.005151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2830b257-6617-494e-af04-2ad43c645b0c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:36.014389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2830b257-6617-494e-af04-2ad43c645b0c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:36.014843 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2830b257-6617-494e-af04-2ad43c645b0c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:36.015599 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2830b257-6617-494e-af04-2ad43c645b0c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:36.016031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2830b257-6617-494e-af04-2ad43c645b0c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:36.111724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2830b257-6617-494e-af04-2ad43c645b0c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28478 microversion: 2.1 time: 0.114912 Dec 24 05:11:36.112389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 682/1292] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:35 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28478 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:37.128447 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e7149444-0231-4b21-a8cd-b552ecaa9476 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:37.130118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e7149444-0231-4b21-a8cd-b552ecaa9476 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:37.141552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7149444-0231-4b21-a8cd-b552ecaa9476 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:37.142290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7149444-0231-4b21-a8cd-b552ecaa9476 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:37.143559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7149444-0231-4b21-a8cd-b552ecaa9476 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:37.144261 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e7149444-0231-4b21-a8cd-b552ecaa9476 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:37.232122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e7149444-0231-4b21-a8cd-b552ecaa9476 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28478 microversion: 2.1 time: 0.109953 Dec 24 05:11:37.233168 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 611/1293] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:37 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28478 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:38.250108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-04b5cea9-17e1-4650-a2dd-0a1eadf11710 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:38.251395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-04b5cea9-17e1-4650-a2dd-0a1eadf11710 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:38.261331 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04b5cea9-17e1-4650-a2dd-0a1eadf11710 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:38.261967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04b5cea9-17e1-4650-a2dd-0a1eadf11710 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:38.263059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04b5cea9-17e1-4650-a2dd-0a1eadf11710 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:38.263663 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-04b5cea9-17e1-4650-a2dd-0a1eadf11710 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:38.374627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-04b5cea9-17e1-4650-a2dd-0a1eadf11710 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.129383 Dec 24 05:11:38.375651 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 683/1294] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:38 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:39.394061 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6ee5d52f-5e8a-4083-a019-3d28c4ac62c5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:39.395742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6ee5d52f-5e8a-4083-a019-3d28c4ac62c5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:39.407234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ee5d52f-5e8a-4083-a019-3d28c4ac62c5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:39.407837 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ee5d52f-5e8a-4083-a019-3d28c4ac62c5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:39.408990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ee5d52f-5e8a-4083-a019-3d28c4ac62c5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:39.409555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ee5d52f-5e8a-4083-a019-3d28c4ac62c5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:39.496580 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6ee5d52f-5e8a-4083-a019-3d28c4ac62c5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.109251 Dec 24 05:11:39.497425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 612/1295] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:39 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:40.513953 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e0351288-3fca-44a9-b577-7bfe7e0fe18d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:40.516450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e0351288-3fca-44a9-b577-7bfe7e0fe18d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:40.532083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0351288-3fca-44a9-b577-7bfe7e0fe18d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:40.532584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0351288-3fca-44a9-b577-7bfe7e0fe18d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:40.533365 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0351288-3fca-44a9-b577-7bfe7e0fe18d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:40.533795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e0351288-3fca-44a9-b577-7bfe7e0fe18d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:40.620921 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e0351288-3fca-44a9-b577-7bfe7e0fe18d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.113145 Dec 24 05:11:40.622192 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 684/1296] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:40 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:41.639937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7c5070bd-c692-49e6-b975-03b39e9b8bb4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:41.640889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7c5070bd-c692-49e6-b975-03b39e9b8bb4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:41.648198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c5070bd-c692-49e6-b975-03b39e9b8bb4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:41.648691 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c5070bd-c692-49e6-b975-03b39e9b8bb4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:41.649480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c5070bd-c692-49e6-b975-03b39e9b8bb4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:41.649908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7c5070bd-c692-49e6-b975-03b39e9b8bb4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:41.734142 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7c5070bd-c692-49e6-b975-03b39e9b8bb4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.100663 Dec 24 05:11:41.735170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 613/1297] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:41 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:42.750539 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-462deefc-125f-4d6b-9257-1787b5a19c2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:42.751529 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-462deefc-125f-4d6b-9257-1787b5a19c2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:42.759064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-462deefc-125f-4d6b-9257-1787b5a19c2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:42.759525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-462deefc-125f-4d6b-9257-1787b5a19c2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:42.760346 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-462deefc-125f-4d6b-9257-1787b5a19c2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:42.760839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-462deefc-125f-4d6b-9257-1787b5a19c2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:42.850615 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-462deefc-125f-4d6b-9257-1787b5a19c2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.105192 Dec 24 05:11:42.851247 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 685/1298] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:42 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:43.865725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7d93c56a-1dda-486a-94b9-a2b1f54e07e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:43.866748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7d93c56a-1dda-486a-94b9-a2b1f54e07e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:43.874076 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d93c56a-1dda-486a-94b9-a2b1f54e07e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:43.874536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d93c56a-1dda-486a-94b9-a2b1f54e07e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:43.875304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d93c56a-1dda-486a-94b9-a2b1f54e07e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:43.875750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7d93c56a-1dda-486a-94b9-a2b1f54e07e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:43.959890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7d93c56a-1dda-486a-94b9-a2b1f54e07e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.097761 Dec 24 05:11:43.960566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 614/1299] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:43 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:44.973035 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f801dd33-973d-48d8-a91e-c6da8df0d54d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:44.974072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f801dd33-973d-48d8-a91e-c6da8df0d54d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:44.981282 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f801dd33-973d-48d8-a91e-c6da8df0d54d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:44.981724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f801dd33-973d-48d8-a91e-c6da8df0d54d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:44.982525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f801dd33-973d-48d8-a91e-c6da8df0d54d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:44.982976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f801dd33-973d-48d8-a91e-c6da8df0d54d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:45.070824 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f801dd33-973d-48d8-a91e-c6da8df0d54d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.101363 Dec 24 05:11:45.071822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 686/1300] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:44 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:46.090398 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c8dea2e2-95fb-43cc-93bf-bdd26e3adaf7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:46.092056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c8dea2e2-95fb-43cc-93bf-bdd26e3adaf7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:46.105116 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8dea2e2-95fb-43cc-93bf-bdd26e3adaf7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:46.106067 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8dea2e2-95fb-43cc-93bf-bdd26e3adaf7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:46.107374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8dea2e2-95fb-43cc-93bf-bdd26e3adaf7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:46.108279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c8dea2e2-95fb-43cc-93bf-bdd26e3adaf7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:46.194558 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c8dea2e2-95fb-43cc-93bf-bdd26e3adaf7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.110689 Dec 24 05:11:46.195441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 615/1301] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:46 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:47.214063 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2c5b9b60-6721-4aac-80f3-04b7cb3292cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:47.215651 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2c5b9b60-6721-4aac-80f3-04b7cb3292cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:47.224047 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c5b9b60-6721-4aac-80f3-04b7cb3292cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:47.224481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c5b9b60-6721-4aac-80f3-04b7cb3292cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:47.225350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c5b9b60-6721-4aac-80f3-04b7cb3292cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:47.225773 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c5b9b60-6721-4aac-80f3-04b7cb3292cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:47.322256 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2c5b9b60-6721-4aac-80f3-04b7cb3292cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.114957 Dec 24 05:11:47.323050 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 687/1302] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:47 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:48.335064 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d1ac8591-942a-43f3-9ab3-c78e18cb39dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:48.336124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d1ac8591-942a-43f3-9ab3-c78e18cb39dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:48.344491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1ac8591-942a-43f3-9ab3-c78e18cb39dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:48.344957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1ac8591-942a-43f3-9ab3-c78e18cb39dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:48.345734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1ac8591-942a-43f3-9ab3-c78e18cb39dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:48.346160 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d1ac8591-942a-43f3-9ab3-c78e18cb39dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:48.438870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d1ac8591-942a-43f3-9ab3-c78e18cb39dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.107649 Dec 24 05:11:48.439889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 616/1303] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:48 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:49.463601 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e1dde025-5652-42c7-a1f6-8d36303349d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:49.466292 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e1dde025-5652-42c7-a1f6-8d36303349d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:49.477512 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1dde025-5652-42c7-a1f6-8d36303349d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:49.478029 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1dde025-5652-42c7-a1f6-8d36303349d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:49.479124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1dde025-5652-42c7-a1f6-8d36303349d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:49.479712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e1dde025-5652-42c7-a1f6-8d36303349d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:49.567357 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e1dde025-5652-42c7-a1f6-8d36303349d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.115765 Dec 24 05:11:49.568431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 688/1304] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:49 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:50.582196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-010d6713-b581-49c1-b7a3-d44472b52080 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:50.583212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-010d6713-b581-49c1-b7a3-d44472b52080 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:50.591651 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-010d6713-b581-49c1-b7a3-d44472b52080 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:50.592097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-010d6713-b581-49c1-b7a3-d44472b52080 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:50.593184 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-010d6713-b581-49c1-b7a3-d44472b52080 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:50.593662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-010d6713-b581-49c1-b7a3-d44472b52080 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:50.676541 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-010d6713-b581-49c1-b7a3-d44472b52080 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.098349 Dec 24 05:11:50.677461 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 617/1305] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:50 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:51.691863 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-09130bd2-a60c-46a6-a2a6-c88e78fba982 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:51.693032 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-09130bd2-a60c-46a6-a2a6-c88e78fba982 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:51.701969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09130bd2-a60c-46a6-a2a6-c88e78fba982 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:51.702525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09130bd2-a60c-46a6-a2a6-c88e78fba982 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:51.703487 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09130bd2-a60c-46a6-a2a6-c88e78fba982 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:51.704021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-09130bd2-a60c-46a6-a2a6-c88e78fba982 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:54.272819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-09130bd2-a60c-46a6-a2a6-c88e78fba982 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 2.585703 Dec 24 05:11:54.273849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 689/1306] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:51 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:55.292238 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f2b159ff-bdec-46f3-86bb-771943e1b966 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:55.295997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f2b159ff-bdec-46f3-86bb-771943e1b966 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:55.305206 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2b159ff-bdec-46f3-86bb-771943e1b966 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:55.305656 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2b159ff-bdec-46f3-86bb-771943e1b966 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:55.306455 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2b159ff-bdec-46f3-86bb-771943e1b966 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:55.306891 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f2b159ff-bdec-46f3-86bb-771943e1b966 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:55.399573 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f2b159ff-bdec-46f3-86bb-771943e1b966 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.115710 Dec 24 05:11:55.400235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 618/1307] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:55 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:56.414887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0f3786ea-90e6-4325-9acb-dbcc0b82d72e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:56.416038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0f3786ea-90e6-4325-9acb-dbcc0b82d72e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:56.425208 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f3786ea-90e6-4325-9acb-dbcc0b82d72e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:56.425716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f3786ea-90e6-4325-9acb-dbcc0b82d72e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:56.426611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f3786ea-90e6-4325-9acb-dbcc0b82d72e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:56.427106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f3786ea-90e6-4325-9acb-dbcc0b82d72e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:56.513912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0f3786ea-90e6-4325-9acb-dbcc0b82d72e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.103616 Dec 24 05:11:56.514581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 690/1308] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:56 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:57.530730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2625ca11-3c67-4f69-94fa-d0b6c5811c4b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:57.532425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2625ca11-3c67-4f69-94fa-d0b6c5811c4b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:57.544224 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2625ca11-3c67-4f69-94fa-d0b6c5811c4b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:57.545017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2625ca11-3c67-4f69-94fa-d0b6c5811c4b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:57.546279 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2625ca11-3c67-4f69-94fa-d0b6c5811c4b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:57.546983 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2625ca11-3c67-4f69-94fa-d0b6c5811c4b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:57.640036 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2625ca11-3c67-4f69-94fa-d0b6c5811c4b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.115930 Dec 24 05:11:57.640636 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 619/1309] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:57 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:58.655779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-be910217-6eed-4cbb-953b-7724c9737cd8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:58.656964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-be910217-6eed-4cbb-953b-7724c9737cd8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:58.665027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be910217-6eed-4cbb-953b-7724c9737cd8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:58.665472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be910217-6eed-4cbb-953b-7724c9737cd8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:58.666254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be910217-6eed-4cbb-953b-7724c9737cd8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:58.666686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-be910217-6eed-4cbb-953b-7724c9737cd8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:58.752638 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-be910217-6eed-4cbb-953b-7724c9737cd8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.102986 Dec 24 05:11:58.753267 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 691/1310] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:58 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:11:59.769600 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7943e88b-df59-4359-83b9-fae1adac0b82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:11:59.770657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7943e88b-df59-4359-83b9-fae1adac0b82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:11:59.779212 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7943e88b-df59-4359-83b9-fae1adac0b82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:59.779738 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7943e88b-df59-4359-83b9-fae1adac0b82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:59.780693 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7943e88b-df59-4359-83b9-fae1adac0b82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:11:59.781229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7943e88b-df59-4359-83b9-fae1adac0b82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:11:59.868850 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7943e88b-df59-4359-83b9-fae1adac0b82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.105605 Dec 24 05:11:59.869688 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 620/1311] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:11:59 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:00.883705 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a8bae099-9be3-4e75-85b2-8bdf9f4d0e6d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:00.884807 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a8bae099-9be3-4e75-85b2-8bdf9f4d0e6d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:00.891764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8bae099-9be3-4e75-85b2-8bdf9f4d0e6d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:00.892203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8bae099-9be3-4e75-85b2-8bdf9f4d0e6d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:00.892998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8bae099-9be3-4e75-85b2-8bdf9f4d0e6d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:00.893420 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a8bae099-9be3-4e75-85b2-8bdf9f4d0e6d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:00.987092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a8bae099-9be3-4e75-85b2-8bdf9f4d0e6d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.107421 Dec 24 05:12:00.987780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 692/1312] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:00 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:01.253752 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-175913722", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1364510469", "security_groups": [{"name": "tempest-secgroup-smoke-2046201915"}], "block_device_mapping_v2": [{"uuid": "157536a6-27ae-4be1-afad-551dddb1d5f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "df2331c3-0dd0-460e-980f-1e2409baa35e"}]}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:01.373616 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.network.neutron [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] validate_networks() for [('df2331c3-0dd0-460e-980f-1e2409baa35e', None, None, None, None, None)] {{(pid=116329) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:12:01.844453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Flavor limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:12:01.844890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Image limits 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:12:01.845384 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Flavor pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:12:01.845785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Image pref 0:0:0 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:12:01.846187 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.virt.hardware [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:12:01.855977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:01.856426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:01.857293 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:01.857727 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:01.874503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:12:01.878879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Getting quotas for user 4039d5c6890448ee99194d769c5c387b and project 8b1a80c6322a493ba10c69a77168b46f. Resources: {'cores', 'ram', 'instances'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:12:01.936482 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Going to run 1 instances... {{(pid=116329) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:12:01.944643 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='157536a6-27ae-4be1-afad-551dddb1d5f8',volume_size=None,volume_type=None)] {{(pid=116329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:12:01.999975 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ddcd5d94-57ba-4ea5-91e6-3b7d8891d364 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:02.001123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ddcd5d94-57ba-4ea5-91e6-3b7d8891d364 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:02.008133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddcd5d94-57ba-4ea5-91e6-3b7d8891d364 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:02.008601 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddcd5d94-57ba-4ea5-91e6-3b7d8891d364 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:02.009385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddcd5d94-57ba-4ea5-91e6-3b7d8891d364 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:02.009810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ddcd5d94-57ba-4ea5-91e6-3b7d8891d364 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:02.071361 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6fedc735-9de1-46df-9cfe-6ac693303c5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824096 Dec 24 05:12:02.072222 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 621/1313] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:12:01 2021] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:12:02.081660 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ceece858-5075-48b0-bc85-98e85ed36042 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:02.082530 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ceece858-5075-48b0-bc85-98e85ed36042 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:02.096223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ddcd5d94-57ba-4ea5-91e6-3b7d8891d364 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.100650 Dec 24 05:12:02.097206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 693/1314] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:01 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:02.136478 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ceece858-5075-48b0-bc85-98e85ed36042 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:02.143025 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ceece858-5075-48b0-bc85-98e85ed36042 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1094 microversion: 2.1 time: 0.065017 Dec 24 05:12:02.143615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 622/1315] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:02 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:12:03.107940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a84c68fc-d94f-4019-943e-f357e59c832c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:03.109001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a84c68fc-d94f-4019-943e-f357e59c832c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:03.116545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a84c68fc-d94f-4019-943e-f357e59c832c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:03.116998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a84c68fc-d94f-4019-943e-f357e59c832c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:03.117752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a84c68fc-d94f-4019-943e-f357e59c832c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:03.118181 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a84c68fc-d94f-4019-943e-f357e59c832c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:03.160131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:03.161466 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:03.169201 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:03.169639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:03.170426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:03.170849 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:03.233904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a84c68fc-d94f-4019-943e-f357e59c832c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.127182 Dec 24 05:12:03.234973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 694/1316] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:03 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:03.255113 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:03.263764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ff495f30-8cac-45fe-9df1-28138c3f250f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1210 microversion: 2.1 time: 0.107388 Dec 24 05:12:03.264430 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 623/1317] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:03 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:04.246779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3923f22d-6f82-42f0-87a4-59d5dca05647 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:04.247911 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3923f22d-6f82-42f0-87a4-59d5dca05647 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:04.254923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3923f22d-6f82-42f0-87a4-59d5dca05647 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:04.255436 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3923f22d-6f82-42f0-87a4-59d5dca05647 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:04.256334 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3923f22d-6f82-42f0-87a4-59d5dca05647 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:04.256855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3923f22d-6f82-42f0-87a4-59d5dca05647 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:04.281385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:04.282136 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:04.288836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:04.289286 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:04.290087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:04.290546 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:04.347468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3923f22d-6f82-42f0-87a4-59d5dca05647 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.104515 Dec 24 05:12:04.348120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 695/1318] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:04 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:04.528620 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:04.538351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.260461 Dec 24 05:12:04.539023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 624/1319] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:04 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:04.695574 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:04.697235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:04.697235 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:12:04.708148 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:04.709101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:04.722016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 service nova] Creating event network-changed:44208746-37c9-4355-a253-acc24e3c178d for instance 9549306d-17cd-474a-afc3-2cbd15168af1 on hv-cinder-81644 Dec 24 05:12:04.726992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036464 Dec 24 05:12:04.727601 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 696/1320] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:12:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:12:05.360156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-94d8bec5-54bf-4c66-a7a5-f142eb192ee5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:05.361482 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-94d8bec5-54bf-4c66-a7a5-f142eb192ee5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:05.371349 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94d8bec5-54bf-4c66-a7a5-f142eb192ee5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:05.372070 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94d8bec5-54bf-4c66-a7a5-f142eb192ee5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:05.373298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94d8bec5-54bf-4c66-a7a5-f142eb192ee5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:05.373801 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-94d8bec5-54bf-4c66-a7a5-f142eb192ee5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:05.556659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:05.557388 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:05.563864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:05.564301 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:05.565129 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:05.565550 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:05.703209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:05.711589 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.159635 Dec 24 05:12:05.712166 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 697/1321] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:05 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:05.757503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-94d8bec5-54bf-4c66-a7a5-f142eb192ee5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.401393 Dec 24 05:12:05.758201 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 625/1322] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:05 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:06.731530 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:06.732407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:06.741879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:06.742377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:06.743518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:06.744101 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:06.771436 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ca0e0b29-7a33-4393-b5e2-bcd3590f744d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:06.772427 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ca0e0b29-7a33-4393-b5e2-bcd3590f744d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:06.779623 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca0e0b29-7a33-4393-b5e2-bcd3590f744d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:06.780068 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca0e0b29-7a33-4393-b5e2-bcd3590f744d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:06.780873 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca0e0b29-7a33-4393-b5e2-bcd3590f744d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:06.781299 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ca0e0b29-7a33-4393-b5e2-bcd3590f744d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:06.864238 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ca0e0b29-7a33-4393-b5e2-bcd3590f744d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.096659 Dec 24 05:12:06.865219 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 626/1323] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:06 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 05:12:06.891557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:06.899094 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-465d5b2f-0234-43c4-b43b-0015ad094106 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.172674 Dec 24 05:12:06.899710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 698/1324] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:06 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:07.880182 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6ba1e457-d63e-4cd9-ab37-6e681b8a7d82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:07.881925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6ba1e457-d63e-4cd9-ab37-6e681b8a7d82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:07.893609 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ba1e457-d63e-4cd9-ab37-6e681b8a7d82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:07.894330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ba1e457-d63e-4cd9-ab37-6e681b8a7d82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:07.895593 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ba1e457-d63e-4cd9-ab37-6e681b8a7d82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:07.896508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6ba1e457-d63e-4cd9-ab37-6e681b8a7d82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:07.916413 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:07.917027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:07.923327 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:07.923783 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:07.924556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:07.924979 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:07.993356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6ba1e457-d63e-4cd9-ab37-6e681b8a7d82 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.119831 Dec 24 05:12:07.994058 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 627/1325] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:07 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:08.071303 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:08.078755 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-43b0460a-cda3-4ec0-bd45-57b634a02aac tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.166499 Dec 24 05:12:08.079330 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 699/1326] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:07 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:09.005773 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6dae4284-b799-48d8-95d7-14e5f1dc2da9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:09.006899 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6dae4284-b799-48d8-95d7-14e5f1dc2da9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:09.013997 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6dae4284-b799-48d8-95d7-14e5f1dc2da9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:09.014448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6dae4284-b799-48d8-95d7-14e5f1dc2da9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:09.015229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6dae4284-b799-48d8-95d7-14e5f1dc2da9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:09.015662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6dae4284-b799-48d8-95d7-14e5f1dc2da9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:09.096323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:09.096954 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:09.104774 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:09.105184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:09.105995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:09.106426 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:09.106583 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6dae4284-b799-48d8-95d7-14e5f1dc2da9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.104819 Dec 24 05:12:09.107244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 628/1327] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:08 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:09.245784 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:09.257136 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6d36e24e-6336-460e-b605-10b58bd34563 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.164286 Dec 24 05:12:09.257612 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 700/1328] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:09 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:10.123404 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-93840641-4e06-4ce9-b606-9cd08aa56cfe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:10.125044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-93840641-4e06-4ce9-b606-9cd08aa56cfe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:10.136586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93840641-4e06-4ce9-b606-9cd08aa56cfe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:10.137320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93840641-4e06-4ce9-b606-9cd08aa56cfe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:10.138601 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93840641-4e06-4ce9-b606-9cd08aa56cfe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:10.139295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-93840641-4e06-4ce9-b606-9cd08aa56cfe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:10.228129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-93840641-4e06-4ce9-b606-9cd08aa56cfe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.111245 Dec 24 05:12:10.229037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 629/1329] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:10 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:10.275440 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:10.276032 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:10.282508 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:10.282948 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:10.283724 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:10.284149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:10.420741 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:10.432716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c03f418d-2464-4cb5-957c-056c19e46925 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.161223 Dec 24 05:12:10.433536 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 701/1330] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:10 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:11.246035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-71c713fd-3ba2-4f51-b1b4-77118b0b795e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:11.247686 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-71c713fd-3ba2-4f51-b1b4-77118b0b795e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:11.257959 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71c713fd-3ba2-4f51-b1b4-77118b0b795e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:11.258400 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71c713fd-3ba2-4f51-b1b4-77118b0b795e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:11.259168 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71c713fd-3ba2-4f51-b1b4-77118b0b795e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:11.259588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-71c713fd-3ba2-4f51-b1b4-77118b0b795e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:11.348544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-71c713fd-3ba2-4f51-b1b4-77118b0b795e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.108821 Dec 24 05:12:11.349204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 630/1331] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:11 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:11.457275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:11.458315 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:11.470254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:11.470987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:11.472243 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:11.473041 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:11.615344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:11.622996 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4883f761-d684-4ada-9402-f3d362ed5dfe tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.171888 Dec 24 05:12:11.623554 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 702/1332] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:11 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:12.361615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d930daf5-b3ac-4c26-abde-2023a959d162 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:12.362604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d930daf5-b3ac-4c26-abde-2023a959d162 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:12.370146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d930daf5-b3ac-4c26-abde-2023a959d162 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:12.370578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d930daf5-b3ac-4c26-abde-2023a959d162 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:12.371351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d930daf5-b3ac-4c26-abde-2023a959d162 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:12.371771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d930daf5-b3ac-4c26-abde-2023a959d162 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:12.463332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d930daf5-b3ac-4c26-abde-2023a959d162 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.105628 Dec 24 05:12:12.463972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 631/1333] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:12 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:12.643070 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:12.643951 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:12.652819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:12.653259 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:12.654034 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:12.654463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:12.794624 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:12.802577 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fa72842b-bf35-4115-97b6-8cb45726a70d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.165750 Dec 24 05:12:12.803145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 703/1334] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:12 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:13.479325 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7694d946-7cfa-4a17-9454-760001c6644e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:13.480373 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7694d946-7cfa-4a17-9454-760001c6644e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:13.488156 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7694d946-7cfa-4a17-9454-760001c6644e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:13.488665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7694d946-7cfa-4a17-9454-760001c6644e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:13.489472 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7694d946-7cfa-4a17-9454-760001c6644e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:13.489923 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7694d946-7cfa-4a17-9454-760001c6644e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:13.579079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7694d946-7cfa-4a17-9454-760001c6644e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.105050 Dec 24 05:12:13.579834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 632/1335] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:13 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:13.824572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:13.825298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:13.831985 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:13.832394 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:13.833218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:13.833635 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:13.971813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:13.979159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-52bd2940-5e51-42d5-a4b9-5748f43345e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.158323 Dec 24 05:12:13.979698 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 704/1336] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:13 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:14.598045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-91b9665d-9e8b-4326-a6fe-abca77dd36e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:14.599667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-91b9665d-9e8b-4326-a6fe-abca77dd36e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:14.610966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91b9665d-9e8b-4326-a6fe-abca77dd36e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:14.611690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91b9665d-9e8b-4326-a6fe-abca77dd36e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:14.613051 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91b9665d-9e8b-4326-a6fe-abca77dd36e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:14.613749 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91b9665d-9e8b-4326-a6fe-abca77dd36e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:14.702179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-91b9665d-9e8b-4326-a6fe-abca77dd36e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 28646 microversion: 2.1 time: 0.110463 Dec 24 05:12:14.703126 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 633/1337] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:14 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 28646 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:14.999086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:15.000090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:15.009672 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:15.010106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:15.010874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:15.011294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:15.173132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:15.180932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.188032 Dec 24 05:12:15.181510 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 705/1338] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:14 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:15.716498 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5060cecd-cf60-4679-8dcd-6de7b5a350bb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:15.717520 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5060cecd-cf60-4679-8dcd-6de7b5a350bb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:15.724679 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5060cecd-cf60-4679-8dcd-6de7b5a350bb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:15.725110 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5060cecd-cf60-4679-8dcd-6de7b5a350bb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:15.725887 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5060cecd-cf60-4679-8dcd-6de7b5a350bb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:15.726500 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5060cecd-cf60-4679-8dcd-6de7b5a350bb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:15.790698 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-41703d0a-87ae-4eec-925d-90359bb9b49f req-006597b1-27f5-45f5-95bf-50589bb57d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "name": "network-vif-plugged", "status": "completed", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:15.792290 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:15.792290 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:12:15.799799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-41703d0a-87ae-4eec-925d-90359bb9b49f req-006597b1-27f5-45f5-95bf-50589bb57d86 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:15.800232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-41703d0a-87ae-4eec-925d-90359bb9b49f req-006597b1-27f5-45f5-95bf-50589bb57d86 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:15.811490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-41703d0a-87ae-4eec-925d-90359bb9b49f req-006597b1-27f5-45f5-95bf-50589bb57d86 service nova] Creating event network-vif-plugged:44208746-37c9-4355-a253-acc24e3c178d for instance 9549306d-17cd-474a-afc3-2cbd15168af1 on hv-cinder-81644 Dec 24 05:12:15.816463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-41703d0a-87ae-4eec-925d-90359bb9b49f req-006597b1-27f5-45f5-95bf-50589bb57d86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029929 Dec 24 05:12:15.816943 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5060cecd-cf60-4679-8dcd-6de7b5a350bb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 30223 microversion: 2.1 time: 0.104313 Dec 24 05:12:15.817159 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 706/1339] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:12:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:12:15.817621 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 634/1340] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:15 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 30223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 05:12:16.202555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:16.203135 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:16.209897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:16.210335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:16.211272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:16.211727 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:16.366325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:16.374306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4170bf65-cb61-43d0-8d27-85161eac4d8f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.176765 Dec 24 05:12:16.374875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 707/1341] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:16 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:12:16.832077 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5c281cc5-0420-418a-be54-3abe07895922 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:16.833081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5c281cc5-0420-418a-be54-3abe07895922 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:16.842479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c281cc5-0420-418a-be54-3abe07895922 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:16.842479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c281cc5-0420-418a-be54-3abe07895922 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:16.842479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c281cc5-0420-418a-be54-3abe07895922 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:16.842479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5c281cc5-0420-418a-be54-3abe07895922 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:16.942190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5c281cc5-0420-418a-be54-3abe07895922 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 32158 microversion: 2.1 time: 0.116548 Dec 24 05:12:16.942840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 635/1342] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:16 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 32158 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:17.392557 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:17.393148 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:17.400214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:17.400697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:17.401484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:17.401914 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:17.551515 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:17.556811 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1266 microversion: 2.1 time: 0.168058 Dec 24 05:12:17.557387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 708/1343] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:17 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:17.960595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4719a9f9-8f4c-497a-99f2-0edc715cc942 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:17.962185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4719a9f9-8f4c-497a-99f2-0edc715cc942 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:17.973105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4719a9f9-8f4c-497a-99f2-0edc715cc942 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:17.973879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4719a9f9-8f4c-497a-99f2-0edc715cc942 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:17.975240 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4719a9f9-8f4c-497a-99f2-0edc715cc942 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:17.975991 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4719a9f9-8f4c-497a-99f2-0edc715cc942 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:18.088807 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4719a9f9-8f4c-497a-99f2-0edc715cc942 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 33342 microversion: 2.1 time: 0.135503 Dec 24 05:12:18.089832 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 636/1344] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:17 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 33342 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:18.574443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:18.575006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:18.581779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:18.582223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:18.582998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:18.583405 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:18.722943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:18.731108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1452 microversion: 2.1 time: 0.160698 Dec 24 05:12:18.731676 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 709/1345] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:18 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:18.799115 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:18.799809 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:18.807102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:18.807559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:18.808335 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:18.808798 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:18.950325 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:18.958133 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1452 microversion: 2.1 time: 0.163126 Dec 24 05:12:18.958697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 637/1346] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:18 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:19.103052 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bdf8e085-13d5-4424-9dd0-20680ce0a28f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:19.103960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bdf8e085-13d5-4424-9dd0-20680ce0a28f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:19.109885 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf8e085-13d5-4424-9dd0-20680ce0a28f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:19.110324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf8e085-13d5-4424-9dd0-20680ce0a28f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:19.111105 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf8e085-13d5-4424-9dd0-20680ce0a28f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:19.111529 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bdf8e085-13d5-4424-9dd0-20680ce0a28f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:19.222871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bdf8e085-13d5-4424-9dd0-20680ce0a28f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 34426 microversion: 2.1 time: 0.123176 Dec 24 05:12:19.223525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 710/1347] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:19 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 34426 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:20.234432 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3a92e8c4-4b58-421c-9177-2a51f4b6e4d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:20.235355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3a92e8c4-4b58-421c-9177-2a51f4b6e4d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:20.241470 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a92e8c4-4b58-421c-9177-2a51f4b6e4d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:20.241886 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a92e8c4-4b58-421c-9177-2a51f4b6e4d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:20.242667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a92e8c4-4b58-421c-9177-2a51f4b6e4d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:20.243092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a92e8c4-4b58-421c-9177-2a51f4b6e4d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:20.341388 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3a92e8c4-4b58-421c-9177-2a51f4b6e4d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 35634 microversion: 2.1 time: 0.110403 Dec 24 05:12:20.342057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 638/1348] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:20 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 35634 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:20.763011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-03efcd9e-8c0a-46df-baa9-6c37372c06bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:20.764495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:20.764495 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:12:20.772659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-03efcd9e-8c0a-46df-baa9-6c37372c06bf service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:20.773167 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-03efcd9e-8c0a-46df-baa9-6c37372c06bf service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:20.784628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-03efcd9e-8c0a-46df-baa9-6c37372c06bf service nova] Creating event network-changed:44208746-37c9-4355-a253-acc24e3c178d for instance 9549306d-17cd-474a-afc3-2cbd15168af1 on hv-cinder-81644 Dec 24 05:12:20.789505 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-03efcd9e-8c0a-46df-baa9-6c37372c06bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030467 Dec 24 05:12:20.790275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 711/1349] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:12:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:12:21.354704 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-40f4c908-10fb-4ae3-be22-37729b2da728 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:21.355715 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-40f4c908-10fb-4ae3-be22-37729b2da728 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:21.362775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f4c908-10fb-4ae3-be22-37729b2da728 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:21.363223 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f4c908-10fb-4ae3-be22-37729b2da728 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:21.364004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f4c908-10fb-4ae3-be22-37729b2da728 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:21.364456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-40f4c908-10fb-4ae3-be22-37729b2da728 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:21.480174 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-40f4c908-10fb-4ae3-be22-37729b2da728 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 37252 microversion: 2.1 time: 0.129556 Dec 24 05:12:21.480884 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 639/1350] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:21 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 37252 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:22.497544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ad3cdabf-5700-4c67-acb0-dc8b68fb503a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:22.498936 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ad3cdabf-5700-4c67-acb0-dc8b68fb503a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:22.508511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ad3cdabf-5700-4c67-acb0-dc8b68fb503a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:22.508983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ad3cdabf-5700-4c67-acb0-dc8b68fb503a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:22.509766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ad3cdabf-5700-4c67-acb0-dc8b68fb503a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:22.510195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ad3cdabf-5700-4c67-acb0-dc8b68fb503a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:22.616594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ad3cdabf-5700-4c67-acb0-dc8b68fb503a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 38176 microversion: 2.1 time: 0.125219 Dec 24 05:12:22.617476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 712/1351] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:22 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 38176 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:23.636703 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f5e2e77c-63c4-4304-ac08-4db2434d835c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:23.638292 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f5e2e77c-63c4-4304-ac08-4db2434d835c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:23.650248 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5e2e77c-63c4-4304-ac08-4db2434d835c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:23.651000 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5e2e77c-63c4-4304-ac08-4db2434d835c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:23.652342 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5e2e77c-63c4-4304-ac08-4db2434d835c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:23.652932 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5e2e77c-63c4-4304-ac08-4db2434d835c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:23.741492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f5e2e77c-63c4-4304-ac08-4db2434d835c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 38176 microversion: 2.1 time: 0.111138 Dec 24 05:12:23.742615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 640/1352] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:23 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 38176 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:24.758717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6749cace-84ca-4bf7-bc5f-51261a81633d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:24.760075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6749cace-84ca-4bf7-bc5f-51261a81633d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:24.767403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6749cace-84ca-4bf7-bc5f-51261a81633d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:24.767848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6749cace-84ca-4bf7-bc5f-51261a81633d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:24.768667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6749cace-84ca-4bf7-bc5f-51261a81633d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:24.769103 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6749cace-84ca-4bf7-bc5f-51261a81633d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:24.857843 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6749cace-84ca-4bf7-bc5f-51261a81633d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 38176 microversion: 2.1 time: 0.105435 Dec 24 05:12:24.858736 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 713/1353] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:24 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 38176 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:25.878140 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-556581f4-f219-4b85-93b5-557fac7c1d81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:25.880017 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-556581f4-f219-4b85-93b5-557fac7c1d81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:25.895664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-556581f4-f219-4b85-93b5-557fac7c1d81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:25.896987 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-556581f4-f219-4b85-93b5-557fac7c1d81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:25.898324 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-556581f4-f219-4b85-93b5-557fac7c1d81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:25.899152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-556581f4-f219-4b85-93b5-557fac7c1d81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:25.999503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-556581f4-f219-4b85-93b5-557fac7c1d81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 38176 microversion: 2.1 time: 0.129438 Dec 24 05:12:26.000570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 641/1354] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:25 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 38176 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:27.018594 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0eddda54-9f77-4015-95cb-f3c951d87bee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:27.020226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0eddda54-9f77-4015-95cb-f3c951d87bee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:27.031813 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0eddda54-9f77-4015-95cb-f3c951d87bee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:27.032450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0eddda54-9f77-4015-95cb-f3c951d87bee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:27.033796 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0eddda54-9f77-4015-95cb-f3c951d87bee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:27.034511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0eddda54-9f77-4015-95cb-f3c951d87bee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:27.138558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0eddda54-9f77-4015-95cb-f3c951d87bee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 200 len: 38305 microversion: 2.1 time: 0.126351 Dec 24 05:12:27.139479 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 714/1355] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:27 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 38305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:12:27.155998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2916db21-a93a-4f8b-a971-9027c1069ced tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:27.157002 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2916db21-a93a-4f8b-a971-9027c1069ced tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:27.167469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2916db21-a93a-4f8b-a971-9027c1069ced tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:27.167908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2916db21-a93a-4f8b-a971-9027c1069ced tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:27.168702 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2916db21-a93a-4f8b-a971-9027c1069ced tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:27.169124 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2916db21-a93a-4f8b-a971-9027c1069ced tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:27.196215 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2916db21-a93a-4f8b-a971-9027c1069ced tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/ips" status: 200 len: 147 microversion: 2.1 time: 0.047368 Dec 24 05:12:27.196963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 642/1356] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Dec 24 05:12:27 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:12:29.609683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fbb58e46-4502-4037-851b-89d8f75ae153 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76f97991-0542-4fdb-9fcc-2a171ac08a85"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:29.610839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fbb58e46-4502-4037-851b-89d8f75ae153 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:29.618132 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbb58e46-4502-4037-851b-89d8f75ae153 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:29.618566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbb58e46-4502-4037-851b-89d8f75ae153 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:29.619338 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbb58e46-4502-4037-851b-89d8f75ae153 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:29.619893 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fbb58e46-4502-4037-851b-89d8f75ae153 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:29.893848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fbb58e46-4502-4037-851b-89d8f75ae153 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288252 Dec 24 05:12:29.894454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 715/1357] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:12:29 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:12:37.415245 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-96098fb3-c6b1-4cb5-83ae-89845bdbbf89 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:37.422199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-96098fb3-c6b1-4cb5-83ae-89845bdbbf89 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:37.422616 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-96098fb3-c6b1-4cb5-83ae-89845bdbbf89 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:37.486848 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-96098fb3-c6b1-4cb5-83ae-89845bdbbf89 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Going to try to stop instance {{(pid=116329) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 24 05:12:37.537607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-96098fb3-c6b1-4cb5-83ae-89845bdbbf89 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 202 len: 0 microversion: 2.1 time: 0.125857 Dec 24 05:12:37.538204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 643/1358] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:37 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:12:37.547306 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:37.548189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:37.554667 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:37.555112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:37.556023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:37.556452 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:37.697607 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:37.705779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-edd73ee6-d600-455e-bd75-a9f580d2a444 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.163077 Dec 24 05:12:37.706343 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 716/1359] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:37 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:38.728678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:38.729442 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:38.739615 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:38.740259 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:38.741513 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:38.742093 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:38.885270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:38.894012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.172941 Dec 24 05:12:38.894588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 644/1360] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:38 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:39.915748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:39.916810 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:39.926364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:39.926807 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:39.927571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:39.927995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:40.067750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:40.076439 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8eaa2f8d-99c1-44ef-82f1-340182e32682 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.167307 Dec 24 05:12:40.077022 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 717/1361] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:39 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:41.097973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:41.098791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:41.107576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:41.108213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:41.109351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:41.109983 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:41.254421 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:41.263013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e79fc537-1775-4af2-bae2-ee1a4fc82374 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.170943 Dec 24 05:12:41.263622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 645/1362] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:41 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:42.284385 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:42.285418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:42.295560 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:42.296291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:42.297714 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:42.298417 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:42.436088 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:42.445497 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8b14bd28-c257-4fba-a41c-2a4746d1d294 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.167670 Dec 24 05:12:42.446053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 718/1363] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:42 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:43.466676 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:43.467662 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:43.475658 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:43.476094 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:43.476926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:43.477350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:43.618877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:43.631167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f16fbb85-8ac1-4ca2-8380-7a401966f458 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.170365 Dec 24 05:12:43.631970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 646/1364] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:43 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:44.653776 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:44.654658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:44.662912 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:44.663359 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:44.664134 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:44.664569 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:44.803215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:44.811768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-88a1524c-ebab-4819-9fb4-b63675efa258 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.164426 Dec 24 05:12:44.812328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 719/1365] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:44 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:45.831995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:45.832841 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:45.842031 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:45.842620 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:45.843693 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:45.844267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:45.989249 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:45.997638 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-991d2e33-60ff-4ac9-b080-e936e1a80b8e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.171534 Dec 24 05:12:45.998216 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 647/1366] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:45 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:47.019184 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:47.020240 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:47.030803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:47.031628 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:47.032986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:47.033700 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:47.176189 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:47.184453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.172225 Dec 24 05:12:47.185068 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 720/1367] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:47 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:48.205791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:48.206669 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:48.214256 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:48.214700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:48.215477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:48.215901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:48.353657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:48.362271 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.162902 Dec 24 05:12:48.362863 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 648/1368] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:48 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:49.384668 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:49.385226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:49.392108 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:49.392562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:49.393353 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:49.393785 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:49.533391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:49.541950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.161042 Dec 24 05:12:49.542519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 721/1369] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:49 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:50.559337 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:50.559939 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:50.566518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:50.567023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:50.567870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:50.568585 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:50.712072 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:50.723447 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8f129778-b929-4ac0-9616-c80e513f6b80 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.167721 Dec 24 05:12:50.724201 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 649/1370] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:50 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:51.744329 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:51.745113 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:51.753750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:51.754355 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:51.755379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:51.758060 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:51.905723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:51.919460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-146e1d4a-d77e-4217-aa18-580d60d34226 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.180653 Dec 24 05:12:51.920241 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 722/1371] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:51 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:52.947137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:52.948089 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:52.962801 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:52.963533 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:52.964894 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:52.965602 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:53.112544 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:53.124909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e1680b1a-94ea-446a-b02f-5a7658255b72 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.184510 Dec 24 05:12:53.125637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 650/1372] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:52 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:54.148555 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:54.149224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:54.156364 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:54.156861 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:54.157672 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:54.158123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:54.293999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:54.306603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d1086966-05a3-41d7-ae83-4aab7b531a3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.164221 Dec 24 05:12:54.307378 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 723/1373] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:54 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:55.326453 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:55.327062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:55.333801 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:55.334608 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:55.335385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:55.335837 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:55.478154 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:55.486047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-588eec84-bb6b-48aa-b425-a4b4aa361d9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.163357 Dec 24 05:12:55.486651 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 651/1374] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:55 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:56.506174 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:56.506828 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:56.514018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:56.514450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:56.515280 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:56.515707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:56.675473 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:56.686683 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6a9a1268-11a8-4e87-822a-9bee6078c281 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.186134 Dec 24 05:12:56.687349 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 724/1375] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:56 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:57.712319 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:57.712959 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:57.719609 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:57.720056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:57.720862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:57.721288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:57.872870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:57.885701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c161f8c6-bcb2-47ff-8200-f8059875294f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1724 microversion: 2.1 time: 0.179700 Dec 24 05:12:57.886528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 652/1376] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:57 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:58.911643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:58.912642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:58.920084 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:58.920544 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:58.921324 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:58.921746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:59.064636 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:59.074000 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1701 microversion: 2.1 time: 0.168148 Dec 24 05:12:59.074580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 725/1377] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:58 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1701 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:12:59.091875 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2da683ce-29b9-4227-98e4-df2e08d41aa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:12:59.099002 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2da683ce-29b9-4227-98e4-df2e08d41aa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:59.099450 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2da683ce-29b9-4227-98e4-df2e08d41aa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:59.122307 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2da683ce-29b9-4227-98e4-df2e08d41aa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Going to try to start instance {{(pid=116329) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 24 05:12:59.172405 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2da683ce-29b9-4227-98e4-df2e08d41aa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 202 len: 0 microversion: 2.1 time: 0.084751 Dec 24 05:12:59.173143 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 653/1378] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:12:59 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:12:59.181548 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:12:59.182187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:12:59.188309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:59.188965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:59.189889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:12:59.190320 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:12:59.328291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:12:59.337149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e64b2990-0083-4897-bf66-10b3202eaea6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1710 microversion: 2.1 time: 0.159347 Dec 24 05:12:59.337875 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 726/1379] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:12:59 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:13:00.356577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:13:00.357288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:13:00.363982 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:00.364425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:00.365230 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:00.365647 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:00.505563 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:13:00.514079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1710 microversion: 2.1 time: 0.162308 Dec 24 05:13:00.514658 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 654/1380] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:13:00 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:13:01.535705 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:13:01.536733 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:13:01.547285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:01.548073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:01.549417 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:01.550130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:01.692092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:13:01.701792 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-23253528-0f70-4e0c-8318-69c4ad955a83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1714 microversion: 2.1 time: 0.172016 Dec 24 05:13:01.702599 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 727/1381] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:13:01 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1714 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:13:01.935801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:13:01.936285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:13:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:13:57.240817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:13:57.241521 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:13:57.249155 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:57.249652 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:57.250509 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:57.250983 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:57.339257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.objects.instance [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lazy-loading 'services' on Instance uuid 5096ad5d-d707-4082-908c-d12a3d5519cc {{(pid=116329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:13:57.412316 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-66b825ab-c37a-4510-ad3d-a0cc08b09d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-volume_attachments/76f97991-0542-4fdb-9fcc-2a171ac08a85" status: 202 len: 0 microversion: 2.1 time: 0.175564 Dec 24 05:13:57.412985 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 655/1382] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:13:57 2021] DELETE /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-volume_attachments/76f97991-0542-4fdb-9fcc-2a171ac08a85 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:13:58.530829 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c487027c-afcf-4374-8a5f-14fb47f28c83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:13:58.538949 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c487027c-afcf-4374-8a5f-14fb47f28c83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:58.539403 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c487027c-afcf-4374-8a5f-14fb47f28c83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:58.614766 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c487027c-afcf-4374-8a5f-14fb47f28c83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Going to try to stop instance {{(pid=116330) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 24 05:13:58.669224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c487027c-afcf-4374-8a5f-14fb47f28c83 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 202 len: 0 microversion: 2.1 time: 0.142025 Dec 24 05:13:58.670236 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 728/1383] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:13:58 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:13:58.682327 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:13:58.683562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:13:58.692914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:58.694054 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:58.695005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:58.695782 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:58.876873 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:13:58.887971 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a1926652-b0c2-487f-bc9c-7e979e580612 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.212117 Dec 24 05:13:58.888561 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 656/1384] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:13:58 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:13:59.911735 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:13:59.913130 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:13:59.924271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:59.925044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:13:59.926311 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:13:59.927026 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:00.062820 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:00.070262 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-60c8336a-bdb8-4c86-b249-00552f2202ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.165590 Dec 24 05:14:00.070799 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 729/1385] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:13:59 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:01.097419 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:01.098408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:01.107401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:01.107851 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:01.108657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:01.109086 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:01.252925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:01.261468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-570c6db3-3121-4976-b2bf-3226a7b027d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.170334 Dec 24 05:14:01.262013 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 657/1386] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:01 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:02.283016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:02.283869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:02.294371 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:02.295107 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:02.296354 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:02.297116 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:02.446083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:02.455049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6440e12c-f7c4-4214-abd7-54a12e9148eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.178579 Dec 24 05:14:02.455620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 730/1387] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:02 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:03.481775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:03.482375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:03.489569 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:03.490048 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:03.490836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:03.491264 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:03.632371 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:03.640456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.163573 Dec 24 05:14:03.641042 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 658/1388] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:03 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:04.657951 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:04.659231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:04.665923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:04.666372 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:04.667585 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:04.668046 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:04.801819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:04.809269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.155158 Dec 24 05:14:04.809839 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 731/1389] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:04 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:05.834974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:05.835628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:05.843294 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:05.843736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:05.844500 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:05.844949 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:05.981291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:05.989526 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f505ff4f-35ba-48e4-8621-497e780c69f4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.161212 Dec 24 05:14:05.992381 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 659/1390] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:05 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:07.010379 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:07.011067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:07.018381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:07.018870 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:07.019716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:07.020186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:07.167559 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:07.176907 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-294b9e66-c38c-445e-b2dc-837935ca1482 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.172771 Dec 24 05:14:07.177474 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 732/1391] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:07 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:08.198152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:08.199176 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:08.210244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:08.210975 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:08.212244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:08.213016 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:08.367330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:08.375146 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f5ff3259-528d-4665-94a2-f76a6561b3d9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1678 microversion: 2.1 time: 0.183111 Dec 24 05:14:08.375719 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 660/1392] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:08 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:09.396274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:09.397275 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:09.408023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:09.408849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:09.410110 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:09.410950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:09.657222 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:09.664923 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1655 microversion: 2.1 time: 0.274705 Dec 24 05:14:09.665462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 733/1393] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:09 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1655 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:09.681277 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ec6de091-b7f5-4411-a27d-774300d78679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:14:09.688018 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ec6de091-b7f5-4411-a27d-774300d78679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:09.688452 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ec6de091-b7f5-4411-a27d-774300d78679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:09.712889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ec6de091-b7f5-4411-a27d-774300d78679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Going to try to start instance {{(pid=116329) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 24 05:14:09.756697 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ec6de091-b7f5-4411-a27d-774300d78679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action" status: 202 len: 0 microversion: 2.1 time: 0.078929 Dec 24 05:14:09.757297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 661/1394] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:14:09 2021] POST /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:14:09.765375 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:09.766007 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:09.772107 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:09.772685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:09.773487 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:09.773995 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:09.907961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:09.915513 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1664 microversion: 2.1 time: 0.153742 Dec 24 05:14:09.916284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 734/1395] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:09 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:10.788578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:10.789343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:10.797291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:10.797743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:10.798510 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:10.798918 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:10.825113 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:14:10.850022 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:14:10.851913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:14:10.851913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:14:10.859114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:10.859634 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:10.876429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 service nova] Creating event network-changed:44208746-37c9-4355-a253-acc24e3c178d for instance 9549306d-17cd-474a-afc3-2cbd15168af1 on hv-cinder-81644 Dec 24 05:14:10.884298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095212 Dec 24 05:14:10.885285 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 735/1396] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:14:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:14:10.905813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-116f687f-ddec-4a8e-a229-62ae6807f1a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 204 len: 0 microversion: 2.1 time: 0.121056 Dec 24 05:14:10.906406 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 662/1397] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:14:10 2021] DELETE /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:14:10.915727 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:10.916578 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:10.922530 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:10.922966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:10.923740 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:10.924170 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:10.934045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:10.935004 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:10.940849 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:10.941927 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:10.942228 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:10.942724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:11.082102 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:11.091019 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1576 microversion: 2.1 time: 0.179152 Dec 24 05:14:11.091600 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 736/1398] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:10 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:11.192443 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:11.200899 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-588ac5c6-33e3-4176-b39d-ca9072e11eec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1664 microversion: 2.1 time: 0.271157 Dec 24 05:14:11.202056 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 663/1399] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:10 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:14:12.112887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:12.113790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:12.122716 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:12.123163 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:12.123943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:12.124376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:12.218983 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:12.219613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:12.227297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:12.227738 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:12.228572 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:12.229396 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:12.276060 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:12.284764 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4ebac5a0-f422-4f82-a891-e8f2a01251ed tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1458 microversion: 2.1 time: 0.178174 Dec 24 05:14:12.285611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 737/1400] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:12 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1458 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:12.414198 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:12.422866 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-09584205-dc17-4add-a095-b7e74006921e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1668 microversion: 2.1 time: 0.207584 Dec 24 05:14:12.423413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 664/1401] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:12 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1668 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:13.302375 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:13.303067 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:13.309900 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:13.310429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:13.311281 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:13.311768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:13.383813 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-10933861-e9cb-454f-b704-506e91a5575b req-03e4865d-5eb3-4e91-a556-b65c66993afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "name": "network-vif-deleted", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:14:13.386907 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:14:13.386907 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:14:13.395972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-10933861-e9cb-454f-b704-506e91a5575b req-03e4865d-5eb3-4e91-a556-b65c66993afe service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:13.396412 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-10933861-e9cb-454f-b704-506e91a5575b req-03e4865d-5eb3-4e91-a556-b65c66993afe service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:13.410291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-10933861-e9cb-454f-b704-506e91a5575b req-03e4865d-5eb3-4e91-a556-b65c66993afe service nova] Creating event network-vif-deleted:44208746-37c9-4355-a253-acc24e3c178d for instance 9549306d-17cd-474a-afc3-2cbd15168af1 on hv-cinder-81644 Dec 24 05:14:13.415876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-10933861-e9cb-454f-b704-506e91a5575b req-03e4865d-5eb3-4e91-a556-b65c66993afe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035694 Dec 24 05:14:13.417267 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 665/1402] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:14:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:14:13.607203 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:13.614767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 200 len: 1390 microversion: 2.1 time: 0.316136 Dec 24 05:14:13.615317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 738/1403] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:13 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 1390 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:13.911714 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:14:13.911937 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:14:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:14:14.632647 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:14.634459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 9549306d-17cd-474a-afc3-2cbd15168af1] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:14.641903 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:14.642368 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:14.643194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:14.643613 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:14.657075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] HTTP exception thrown: Instance 9549306d-17cd-474a-afc3-2cbd15168af1 could not be found. Dec 24 05:14:14.657649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Returning 404 to user: Instance 9549306d-17cd-474a-afc3-2cbd15168af1 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:14:14.658454 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2971b7a4-7c41-4df7-b017-5c4075a56bf7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1" status: 404 len: 111 microversion: 2.1 time: 0.030027 Dec 24 05:14:14.658977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 666/1404] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:14 2021] GET /compute/v2.1/servers/9549306d-17cd-474a-afc3-2cbd15168af1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:14:17.805213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:17.805825 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:17.808090 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-03edb431-f875-489c-b9f8-70da308fd707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:14:17.810078 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:14:17.810078 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:14:17.812349 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:17.812808 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:17.813567 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:17.814220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:17.817576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-03edb431-f875-489c-b9f8-70da308fd707 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:17.818332 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-03edb431-f875-489c-b9f8-70da308fd707 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:17.829666 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-03edb431-f875-489c-b9f8-70da308fd707 service nova] Creating event network-changed:4f943d44-a70c-4b88-9cac-b16783cab1e5 for instance 067b7d98-4174-409c-85af-47a2dbf63a71 on hv-cinder-81644 Dec 24 05:14:17.835226 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-03edb431-f875-489c-b9f8-70da308fd707 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030593 Dec 24 05:14:17.836021 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 667/1405] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:14:17.843490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:14:17.931017 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-83788575-1799-42d7-98a5-4ebef89472d4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 204 len: 0 microversion: 2.1 time: 0.129271 Dec 24 05:14:17.931623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 739/1406] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:14:17 2021] DELETE /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:14:17.940378 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:17.941190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:17.947489 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:17.948011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:17.948890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:17.949426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:18.192434 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:18.201191 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-17049ba7-55a7-4aeb-82d1-da91750db0e4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1578 microversion: 2.1 time: 0.264767 Dec 24 05:14:18.201736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 668/1407] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:17 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1578 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:19.222181 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:19.223043 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:19.231639 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:19.232187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:19.233173 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:19.233701 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:19.380994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:19.388567 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae973b39-5864-40d8-adb8-cae60932e8f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1459 microversion: 2.1 time: 0.171465 Dec 24 05:14:19.389172 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 740/1408] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:19 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:20.255765 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-9b74e44a-385e-4482-852a-e3e58bedad20 req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "name": "network-vif-deleted", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:14:20.257844 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:14:20.257844 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:14:20.267186 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-9b74e44a-385e-4482-852a-e3e58bedad20 req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:20.267618 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-9b74e44a-385e-4482-852a-e3e58bedad20 req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:20.279291 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-9b74e44a-385e-4482-852a-e3e58bedad20 req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe service nova] Creating event network-vif-deleted:4f943d44-a70c-4b88-9cac-b16783cab1e5 for instance 067b7d98-4174-409c-85af-47a2dbf63a71 on hv-cinder-81644 Dec 24 05:14:20.284721 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-9b74e44a-385e-4482-852a-e3e58bedad20 req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032589 Dec 24 05:14:20.285465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 669/1409] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:14:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:14:20.407250 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:20.407787 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:20.414496 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:20.414942 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:20.415712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:20.416145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:20.479092 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039d5c6890448ee99194d769c5c387b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:14:20.486782 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 200 len: 1226 microversion: 2.1 time: 0.083299 Dec 24 05:14:20.487340 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 741/1410] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:20 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:14:21.506376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:21.507138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: 067b7d98-4174-409c-85af-47a2dbf63a71] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:21.515179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:21.515716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:21.516722 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:21.517241 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:21.532637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] HTTP exception thrown: Instance 067b7d98-4174-409c-85af-47a2dbf63a71 could not be found. Dec 24 05:14:21.533218 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Returning 404 to user: Instance 067b7d98-4174-409c-85af-47a2dbf63a71 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:14:21.534059 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fab242fb-2842-43ce-a105-341d57d3b2fd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71" status: 404 len: 111 microversion: 2.1 time: 0.033102 Dec 24 05:14:21.534579 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 670/1411] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:21 2021] GET /compute/v2.1/servers/067b7d98-4174-409c-85af-47a2dbf63a71 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:14:22.006788 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:22.007280 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:22.014155 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:22.014602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:22.015381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:22.015804 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:22.029204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] HTTP exception thrown: Instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 could not be found. Dec 24 05:14:22.029790 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Returning 404 to user: Instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:14:22.030593 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fc1036e5-459b-41e2-9ced-e53ff06ceec1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 404 len: 111 microversion: 2.1 time: 0.027556 Dec 24 05:14:22.031183 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 742/1412] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:14:22 2021] DELETE /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:14:22.039340 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:22.039992 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] [instance: d51afc95-dcbd-4ab4-9e4f-951d2dd7af88] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:14:22.046561 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:22.047008 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:22.047808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:14:22.048242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:14:22.063098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] HTTP exception thrown: Instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 could not be found. Dec 24 05:14:22.063734 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Returning 404 to user: Instance d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:14:22.064565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1e6b8af6-bf4d-43c5-982e-559431d13994 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88" status: 404 len: 111 microversion: 2.1 time: 0.028925 Dec 24 05:14:22.065147 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 671/1413] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:14:22 2021] GET /compute/v2.1/servers/d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:14:23.376836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-82af8b58-fa53-4d77-8cc2-a31320708a33 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling method '.version_select at 0x7f7baea0aa60>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:14:23.399962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-82af8b58-fa53-4d77-8cc2-a31320708a33 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1364510469" status: 202 len: 0 microversion: 2.1 time: 0.026927 Dec 24 05:14:23.400440 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 743/1414] 10.222.0.43 () {58 vars in 1262 bytes} [Fri Dec 24 05:14:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1364510469 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:15:15.653715 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-917f5d6c-5872-4d83-bb99-26ce62267602 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:15.654622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-917f5d6c-5872-4d83-bb99-26ce62267602 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:15.661177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-917f5d6c-5872-4d83-bb99-26ce62267602 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:15.661619 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-917f5d6c-5872-4d83-bb99-26ce62267602 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:15.662413 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-917f5d6c-5872-4d83-bb99-26ce62267602 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:15.662834 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-917f5d6c-5872-4d83-bb99-26ce62267602 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:15.691290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-917f5d6c-5872-4d83-bb99-26ce62267602 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041325 Dec 24 05:15:15.691825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 672/1415] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:15:15 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:15.751002 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:15.751529 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:15.758801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:15.759244 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:15.760028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:15.760453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:15.783877 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Going to try to terminate instance {{(pid=116330) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:15:15.868161 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-764ebf07-9575-46c3-806d-4fa5e1880a7e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 204 len: 0 microversion: 2.1 time: 0.120587 Dec 24 05:15:15.869269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 744/1416] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:15:15 2021] DELETE /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:15:15.878260 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:15.878904 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:15.886771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:15.887367 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:15.888459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:15.889118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:16.036630 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:16.044658 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d5672750-f221-47cc-983c-6bf3adaf46e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1674 microversion: 2.1 time: 0.170041 Dec 24 05:15:16.045227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 673/1417] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:15 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:17.067627 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:17.068966 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:17.075869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:17.076344 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:17.077206 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:17.077649 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:17.220467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:17.231879 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1674 microversion: 2.1 time: 0.170854 Dec 24 05:15:17.232728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 745/1418] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:17 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:18.249806 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:18.250416 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:18.257678 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:18.258098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:18.258908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:18.259337 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:18.793106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:18.800479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-abff0a48-f493-49fe-ae9e-c638c16f1f88 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 200 len: 1674 microversion: 2.1 time: 0.554437 Dec 24 05:15:18.801079 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 674/1419] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:18 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 1674 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:19.254819 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-e5dccbc5-5f3b-41b3-8932-a5c64bbc72ec req-11964b0c-3a5f-4e22-8230-29564f69a286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "name": "network-vif-deleted", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:19.257350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:15:19.257350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:15:19.265562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-e5dccbc5-5f3b-41b3-8932-a5c64bbc72ec req-11964b0c-3a5f-4e22-8230-29564f69a286 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:19.265999 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-e5dccbc5-5f3b-41b3-8932-a5c64bbc72ec req-11964b0c-3a5f-4e22-8230-29564f69a286 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:19.277768 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-e5dccbc5-5f3b-41b3-8932-a5c64bbc72ec req-11964b0c-3a5f-4e22-8230-29564f69a286 service nova] Creating event network-vif-deleted:b3526449-31e3-4b8f-a3a1-329333c58c47 for instance 5096ad5d-d707-4082-908c-d12a3d5519cc on hv-cinder-81644 Dec 24 05:15:19.286257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-e5dccbc5-5f3b-41b3-8932-a5c64bbc72ec req-11964b0c-3a5f-4e22-8230-29564f69a286 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034847 Dec 24 05:15:19.290608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 746/1420] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:15:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 24 05:15:19.817799 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:19.818564 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:19.827401 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:19.828177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:19.829081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:19.829506 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:19.845724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] HTTP exception thrown: Instance 5096ad5d-d707-4082-908c-d12a3d5519cc could not be found. Dec 24 05:15:19.846311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Returning 404 to user: Instance 5096ad5d-d707-4082-908c-d12a3d5519cc could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:15:19.847148 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-deb91da6-3246-417b-9dec-13934c985cb3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 404 len: 111 microversion: 2.1 time: 0.033178 Dec 24 05:15:19.847706 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 675/1421] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:19 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:15:19.856782 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-82a885c4-d3bf-4ce1-a749-91a924f9c1ad tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '.version_select at 0x7f7bae88ee50>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:19.875728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-82a885c4-d3bf-4ce1-a749-91a924f9c1ad tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006078588" status: 202 len: 0 microversion: 2.1 time: 0.022961 Dec 24 05:15:19.876336 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 747/1422] 10.222.0.43 () {58 vars in 1220 bytes} [Fri Dec 24 05:15:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006078588 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:15:20.559931 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'create', calling method: .version_select at 0x7f7bae191040>, body: {"keypair": {"name": "tempest-keypair-1358616395"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:20.574202 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:15:20.578130 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for user bccbafbbab7e4c358b444e4efc684a01 and project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:15:20.590284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [ae8bf218-92a6-4a7c-a9ec-6ef3027d85a6] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 24 05:15:21.602306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [ae8bf218-92a6-4a7c-a9ec-6ef3027d85a6] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52734. Dec 24 05:15:21.853827 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:15:21.857877 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for user bccbafbbab7e4c358b444e4efc684a01 and project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:15:21.871780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8764e609-0339-4727-b65d-35a2975424e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.315570 Dec 24 05:15:21.872376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 676/1423] 10.222.0.43 () {60 vars in 1157 bytes} [Fri Dec 24 05:15:20 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:23.209588 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1014799970", "imageRef": "d0a39846-382f-46ee-af26-1194b7fc8607", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "075b69cb-c546-4fa5-aa29-49a5b85c94b1"}], "security_groups": [{"name": "tempest-securitygroup--1185760474"}], "key_name": "tempest-keypair-1358616395", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:23.313881 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] validate_networks() for [('075b69cb-c546-4fa5-aa29-49a5b85c94b1', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:15:23.802828 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:15:23.803483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:15:23.804140 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:15:23.804858 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:15:23.805661 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:15:23.819779 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:23.820214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:23.821049 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:23.821476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:23.841352 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:15:23.847962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Getting quotas for user bccbafbbab7e4c358b444e4efc684a01 and project fc4cefad8fef403e90ad695e2098ee7b. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:15:23.862904 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:15:23.866224 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0a39846-382f-46ee-af26-1194b7fc8607',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:15:23.912958 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [06d30a36-9e50-4b05-8326-26f3a25da7f7] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 24 05:15:24.922524 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [06d30a36-9e50-4b05-8326-26f3a25da7f7] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52762. Dec 24 05:15:24.928437 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.726042 Dec 24 05:15:24.929123 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 748/1424] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:15:23 2021] POST /compute/v2.1/servers => generated 402 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:15:24.939683 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-01a8df78-e661-40c7-b8a6-daf3e64185d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:24.940246 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-01a8df78-e661-40c7-b8a6-daf3e64185d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:24.995879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-01a8df78-e661-40c7-b8a6-daf3e64185d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:25.003083 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-01a8df78-e661-40c7-b8a6-daf3e64185d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1238 microversion: 2.1 time: 0.067632 Dec 24 05:15:25.003586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 677/1425] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:24 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:26.023757 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c835dd4d-0012-41ef-aaeb-00624daf8893 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:26.024345 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c835dd4d-0012-41ef-aaeb-00624daf8893 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:26.077287 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c835dd4d-0012-41ef-aaeb-00624daf8893 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:26.084988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c835dd4d-0012-41ef-aaeb-00624daf8893 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1238 microversion: 2.1 time: 0.065877 Dec 24 05:15:26.085759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 749/1426] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:26 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:27.105410 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-f69f6768-30bb-43f3-89d3-0f9efdf1757c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:27.106355 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-f69f6768-30bb-43f3-89d3-0f9efdf1757c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:27.166518 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-f69f6768-30bb-43f3-89d3-0f9efdf1757c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:27.174214 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-f69f6768-30bb-43f3-89d3-0f9efdf1757c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1238 microversion: 2.1 time: 0.075110 Dec 24 05:15:27.174773 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 678/1427] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:27 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:28.195157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-fb8d74d4-4082-4507-bf4c-150b40ffb56d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:28.196113 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-fb8d74d4-4082-4507-bf4c-150b40ffb56d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:28.256451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-fb8d74d4-4082-4507-bf4c-150b40ffb56d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:28.263590 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-fb8d74d4-4082-4507-bf4c-150b40ffb56d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1238 microversion: 2.1 time: 0.074507 Dec 24 05:15:28.264152 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 750/1428] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:28 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:29.287242 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:29.288176 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:29.298702 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:29.299443 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:29.300751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:29.301460 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:29.362902 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:29.371424 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1242 microversion: 2.1 time: 0.090470 Dec 24 05:15:29.371977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 679/1429] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:29 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:30.389946 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:30.390583 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:30.399608 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:30.400215 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:30.401230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:30.401727 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:30.471016 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:30.479867 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c4b64e83-4c25-4ccc-847c-03480b380383 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1296 microversion: 2.1 time: 0.093548 Dec 24 05:15:30.480462 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 751/1430] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:30 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:31.498209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:31.498796 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:31.505606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:31.506140 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:31.506995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:31.507491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:31.667707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:31.670707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:15:31.670707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:15:31.680213 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:31.681951 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:31.700023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 service nova] Creating event network-changed:5dfd861f-9d99-4555-bfe9-1c8d6b3f537e for instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 on hv-cinder-81644 Dec 24 05:15:31.706450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043459 Dec 24 05:15:31.707021 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 752/1431] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:15:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:15:31.726535 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:31.734910 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.241348 Dec 24 05:15:31.735475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 680/1432] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:31 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:32.752024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:32.752742 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:32.759680 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:32.760391 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:32.761287 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:32.761718 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:32.913080 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:32.921069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.173156 Dec 24 05:15:32.921639 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 753/1433] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:32 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:33.941479 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:33.942426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:33.950963 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:33.951407 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:33.952173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:33.952622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:34.097330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:34.106805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c149c265-d16d-4b5a-bd25-7d6688f229b7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.171502 Dec 24 05:15:34.107373 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 681/1434] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:33 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:35.127141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:35.128095 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:35.136454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:35.136982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:35.137848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:35.138312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:35.274229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:35.282443 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c6657bf0-9a20-4a70-bd72-09e41004c732 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.161380 Dec 24 05:15:35.282998 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 754/1435] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:35 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:36.303465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:36.304329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:36.317728 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:36.318454 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:36.319724 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:36.320444 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:36.461591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:36.470065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-dda870f6-1b10-43ed-8037-f51a61992ff2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.172919 Dec 24 05:15:36.470631 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 682/1436] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:36 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:37.491068 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:37.491963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:37.499595 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:37.500044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:37.500854 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:37.501315 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:37.646393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:37.654076 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c4bae98e-877e-4020-9553-b7ff9f971e47 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.169313 Dec 24 05:15:37.654642 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 755/1437] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:37 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:38.675569 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:38.676224 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:38.682972 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:38.683459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:38.684574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:38.685011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:38.752169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-1a586e91-4dd6-4807-ae15-e89d1203a28a req-f8b303a1-84fd-420d-910f-91eaf54fe77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "name": "network-vif-plugged", "status": "completed", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:38.753771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:15:38.753771 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:15:38.763075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1a586e91-4dd6-4807-ae15-e89d1203a28a req-f8b303a1-84fd-420d-910f-91eaf54fe77f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:38.763775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1a586e91-4dd6-4807-ae15-e89d1203a28a req-f8b303a1-84fd-420d-910f-91eaf54fe77f service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:38.775280 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-1a586e91-4dd6-4807-ae15-e89d1203a28a req-f8b303a1-84fd-420d-910f-91eaf54fe77f service nova] Creating event network-vif-plugged:5dfd861f-9d99-4555-bfe9-1c8d6b3f537e for instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 on hv-cinder-81644 Dec 24 05:15:38.780849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-1a586e91-4dd6-4807-ae15-e89d1203a28a req-f8b303a1-84fd-420d-910f-91eaf54fe77f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Dec 24 05:15:38.781994 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 756/1438] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:15:38.828059 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:38.835707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.164207 Dec 24 05:15:38.836263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 683/1439] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:38 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:39.857294 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:39.858444 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:39.869419 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:39.870151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:39.871400 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:39.871830 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:40.015925 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:40.023643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-31a9156b-6564-4074-bef9-6786a9c9dc61 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1364 microversion: 2.1 time: 0.173083 Dec 24 05:15:40.024208 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 757/1440] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:39 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:41.044730 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:41.045416 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:41.053576 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:41.054132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:41.055095 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:41.055627 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:41.210047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:15:41.217725 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1550 microversion: 2.1 time: 0.179206 Dec 24 05:15:41.218297 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 684/1441] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:15:41 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1550 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:41.234511 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2414a613-783e-4f52-babe-8a79ac2e4b64 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:15:41.235045 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2414a613-783e-4f52-babe-8a79ac2e4b64 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:41.241580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2414a613-783e-4f52-babe-8a79ac2e4b64 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:41.242027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2414a613-783e-4f52-babe-8a79ac2e4b64 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:41.242802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2414a613-783e-4f52-babe-8a79ac2e4b64 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:41.243234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2414a613-783e-4f52-babe-8a79ac2e4b64 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:41.331759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2414a613-783e-4f52-babe-8a79ac2e4b64 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101241 Dec 24 05:15:41.332352 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 758/1442] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Dec 24 05:15:41 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:15:42.328903 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5d32080e-96e8-4650-a44b-8e5d33792698 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:42.329785 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5d32080e-96e8-4650-a44b-8e5d33792698 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:42.332420 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-a7e81089-eec2-4199-af72-8faf4df1b673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:42.334454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:15:42.334454 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:15:42.337308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d32080e-96e8-4650-a44b-8e5d33792698 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:42.338005 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d32080e-96e8-4650-a44b-8e5d33792698 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:42.338827 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d32080e-96e8-4650-a44b-8e5d33792698 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:42.339254 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5d32080e-96e8-4650-a44b-8e5d33792698 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:42.341935 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-a7e81089-eec2-4199-af72-8faf4df1b673 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:42.342374 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-a7e81089-eec2-4199-af72-8faf4df1b673 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:42.355209 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-a7e81089-eec2-4199-af72-8faf4df1b673 service nova] Creating event network-changed:5dfd861f-9d99-4555-bfe9-1c8d6b3f537e for instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 on hv-cinder-81644 Dec 24 05:15:42.361151 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-a7e81089-eec2-4199-af72-8faf4df1b673 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032784 Dec 24 05:15:42.361965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 759/1443] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:15:42.448170 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5d32080e-96e8-4650-a44b-8e5d33792698 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.122500 Dec 24 05:15:42.451536 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 685/1444] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:42 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:43.460728 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2c85ab7e-0276-4ce8-8459-d447ae61d6a3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:43.461707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2c85ab7e-0276-4ce8-8459-d447ae61d6a3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:43.470620 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c85ab7e-0276-4ce8-8459-d447ae61d6a3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:43.471070 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c85ab7e-0276-4ce8-8459-d447ae61d6a3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:43.472272 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c85ab7e-0276-4ce8-8459-d447ae61d6a3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:43.473064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2c85ab7e-0276-4ce8-8459-d447ae61d6a3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:43.556187 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2c85ab7e-0276-4ce8-8459-d447ae61d6a3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.099772 Dec 24 05:15:43.557098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 760/1445] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:43 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:44.572515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b71b93d4-f0b7-465d-bf5a-1b255f607e8c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:44.574057 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b71b93d4-f0b7-465d-bf5a-1b255f607e8c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:44.585908 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b71b93d4-f0b7-465d-bf5a-1b255f607e8c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:44.586634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b71b93d4-f0b7-465d-bf5a-1b255f607e8c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:44.587893 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b71b93d4-f0b7-465d-bf5a-1b255f607e8c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:44.588612 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b71b93d4-f0b7-465d-bf5a-1b255f607e8c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:44.678459 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b71b93d4-f0b7-465d-bf5a-1b255f607e8c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.112299 Dec 24 05:15:44.679426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 686/1446] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:44 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:45.696501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-58dd9c71-f3d5-4520-81c3-98446221359a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:45.698014 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-58dd9c71-f3d5-4520-81c3-98446221359a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:45.705831 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58dd9c71-f3d5-4520-81c3-98446221359a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:45.706269 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58dd9c71-f3d5-4520-81c3-98446221359a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:45.707040 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58dd9c71-f3d5-4520-81c3-98446221359a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:45.707452 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-58dd9c71-f3d5-4520-81c3-98446221359a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:45.807157 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-58dd9c71-f3d5-4520-81c3-98446221359a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.117009 Dec 24 05:15:45.808133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 761/1447] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:45 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:46.959227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-255595b1-51f1-41d6-ae7b-d11d282cbc29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:46.961485 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-255595b1-51f1-41d6-ae7b-d11d282cbc29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:46.969880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255595b1-51f1-41d6-ae7b-d11d282cbc29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:46.970321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255595b1-51f1-41d6-ae7b-d11d282cbc29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:46.971119 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255595b1-51f1-41d6-ae7b-d11d282cbc29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:46.971546 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-255595b1-51f1-41d6-ae7b-d11d282cbc29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:47.051879 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-255595b1-51f1-41d6-ae7b-d11d282cbc29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.234067 Dec 24 05:15:47.052852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 687/1448] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:46 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:48.069083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0635b1b4-3166-47ed-a88f-4d9b3216ad9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:48.070095 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0635b1b4-3166-47ed-a88f-4d9b3216ad9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:48.077316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0635b1b4-3166-47ed-a88f-4d9b3216ad9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:48.077751 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0635b1b4-3166-47ed-a88f-4d9b3216ad9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:48.078524 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0635b1b4-3166-47ed-a88f-4d9b3216ad9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:48.078961 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0635b1b4-3166-47ed-a88f-4d9b3216ad9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:48.162337 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0635b1b4-3166-47ed-a88f-4d9b3216ad9c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.099064 Dec 24 05:15:48.163038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 762/1449] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:48 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:49.178209 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e76811c3-7a04-49e4-8e3e-b31979a1d5c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:49.179464 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e76811c3-7a04-49e4-8e3e-b31979a1d5c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:49.188508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e76811c3-7a04-49e4-8e3e-b31979a1d5c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:49.189098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e76811c3-7a04-49e4-8e3e-b31979a1d5c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:49.190055 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e76811c3-7a04-49e4-8e3e-b31979a1d5c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:49.190581 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e76811c3-7a04-49e4-8e3e-b31979a1d5c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:49.280129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e76811c3-7a04-49e4-8e3e-b31979a1d5c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.108061 Dec 24 05:15:49.281182 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 688/1450] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:49 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:50.298373 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a2fa9838-a7aa-4c13-8c84-c83f39bf93e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:50.299889 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a2fa9838-a7aa-4c13-8c84-c83f39bf93e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:50.311571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2fa9838-a7aa-4c13-8c84-c83f39bf93e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:50.312310 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2fa9838-a7aa-4c13-8c84-c83f39bf93e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:50.313888 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2fa9838-a7aa-4c13-8c84-c83f39bf93e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:50.314603 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a2fa9838-a7aa-4c13-8c84-c83f39bf93e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:50.400846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a2fa9838-a7aa-4c13-8c84-c83f39bf93e7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.108798 Dec 24 05:15:50.401818 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 763/1451] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:50 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:51.419075 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-b40d5703-94d8-430a-a115-b592d13c0c41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:51.420748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-b40d5703-94d8-430a-a115-b592d13c0c41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:51.430554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b40d5703-94d8-430a-a115-b592d13c0c41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:51.431086 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b40d5703-94d8-430a-a115-b592d13c0c41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:51.431909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b40d5703-94d8-430a-a115-b592d13c0c41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:51.432300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-b40d5703-94d8-430a-a115-b592d13c0c41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:51.526395 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-b40d5703-94d8-430a-a115-b592d13c0c41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 14 microversion: 2.1 time: 0.114027 Dec 24 05:15:51.527374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 689/1452] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:51 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:15:52.544077 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2db77a73-197d-4989-abe3-703bc0587c48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:52.545751 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2db77a73-197d-4989-abe3-703bc0587c48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:52.557738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db77a73-197d-4989-abe3-703bc0587c48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:52.558475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db77a73-197d-4989-abe3-703bc0587c48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:52.559759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db77a73-197d-4989-abe3-703bc0587c48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:52.560468 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2db77a73-197d-4989-abe3-703bc0587c48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:52.654059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2db77a73-197d-4989-abe3-703bc0587c48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 7949 microversion: 2.1 time: 0.116398 Dec 24 05:15:52.655154 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 764/1453] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:52 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 7949 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:15:53.672778 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3272f4c7-784f-4684-8748-116627946d1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:53.674372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3272f4c7-784f-4684-8748-116627946d1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:53.683062 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3272f4c7-784f-4684-8748-116627946d1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:53.683508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3272f4c7-784f-4684-8748-116627946d1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:53.684282 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3272f4c7-784f-4684-8748-116627946d1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:53.684750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3272f4c7-784f-4684-8748-116627946d1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:53.782440 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3272f4c7-784f-4684-8748-116627946d1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 16280 microversion: 2.1 time: 0.115814 Dec 24 05:15:53.783351 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 690/1454] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:53 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 16280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:15:54.800744 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0012ee91-a9ae-462f-acdf-fdaab254a825 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:54.802238 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0012ee91-a9ae-462f-acdf-fdaab254a825 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:54.813884 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0012ee91-a9ae-462f-acdf-fdaab254a825 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:54.814651 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0012ee91-a9ae-462f-acdf-fdaab254a825 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:54.815903 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0012ee91-a9ae-462f-acdf-fdaab254a825 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:54.816699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0012ee91-a9ae-462f-acdf-fdaab254a825 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:54.914042 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0012ee91-a9ae-462f-acdf-fdaab254a825 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 18661 microversion: 2.1 time: 0.120129 Dec 24 05:15:54.914704 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 765/1455] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:54 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 18661 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:15:55.929995 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bcb1b8ae-afd2-4efd-a94d-871de714394b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:55.931002 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bcb1b8ae-afd2-4efd-a94d-871de714394b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:55.938290 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcb1b8ae-afd2-4efd-a94d-871de714394b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:55.938736 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcb1b8ae-afd2-4efd-a94d-871de714394b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:55.939509 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcb1b8ae-afd2-4efd-a94d-871de714394b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:55.939933 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bcb1b8ae-afd2-4efd-a94d-871de714394b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:56.039222 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bcb1b8ae-afd2-4efd-a94d-871de714394b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 21057 microversion: 2.1 time: 0.115027 Dec 24 05:15:56.039840 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 691/1456] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:55 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 21057 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:15:57.056040 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ab47866b-0289-404a-9b0e-7ea6916affea tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:57.058226 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ab47866b-0289-404a-9b0e-7ea6916affea tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:57.069665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab47866b-0289-404a-9b0e-7ea6916affea tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:57.070418 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab47866b-0289-404a-9b0e-7ea6916affea tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:57.071969 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab47866b-0289-404a-9b0e-7ea6916affea tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:57.072411 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab47866b-0289-404a-9b0e-7ea6916affea tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:57.171815 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ab47866b-0289-404a-9b0e-7ea6916affea tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 23045 microversion: 2.1 time: 0.122236 Dec 24 05:15:57.172846 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 766/1457] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:57 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 23045 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:15:58.191037 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6081a0cd-947c-4286-8b8f-cd82ddf58e26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:58.192722 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6081a0cd-947c-4286-8b8f-cd82ddf58e26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:58.202032 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6081a0cd-947c-4286-8b8f-cd82ddf58e26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:58.202475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6081a0cd-947c-4286-8b8f-cd82ddf58e26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:58.203250 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6081a0cd-947c-4286-8b8f-cd82ddf58e26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:58.203680 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6081a0cd-947c-4286-8b8f-cd82ddf58e26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:58.293931 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6081a0cd-947c-4286-8b8f-cd82ddf58e26 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 24626 microversion: 2.1 time: 0.109541 Dec 24 05:15:58.294462 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 692/1458] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:58 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 24626 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:15:59.309783 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-aa02a15b-0f35-4139-b486-cc10296051f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:15:59.310789 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-aa02a15b-0f35-4139-b486-cc10296051f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:15:59.318044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa02a15b-0f35-4139-b486-cc10296051f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:59.318490 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa02a15b-0f35-4139-b486-cc10296051f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:59.319276 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa02a15b-0f35-4139-b486-cc10296051f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:15:59.319702 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-aa02a15b-0f35-4139-b486-cc10296051f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:15:59.411141 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-aa02a15b-0f35-4139-b486-cc10296051f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 26339 microversion: 2.1 time: 0.106897 Dec 24 05:15:59.412162 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 767/1459] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:15:59 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 26339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:00.428179 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d7dde85a-7dcc-45ec-9754-dc7529e08a7d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:00.429435 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d7dde85a-7dcc-45ec-9754-dc7529e08a7d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:00.438174 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d7dde85a-7dcc-45ec-9754-dc7529e08a7d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:00.438606 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d7dde85a-7dcc-45ec-9754-dc7529e08a7d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:00.439384 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d7dde85a-7dcc-45ec-9754-dc7529e08a7d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:00.439806 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d7dde85a-7dcc-45ec-9754-dc7529e08a7d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:00.542194 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d7dde85a-7dcc-45ec-9754-dc7529e08a7d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 27542 microversion: 2.1 time: 0.118630 Dec 24 05:16:00.543289 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 693/1460] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:00 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 27542 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:01.556864 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4299425a-9143-46c1-928a-0ef80a363c71 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:01.558085 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4299425a-9143-46c1-928a-0ef80a363c71 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:01.565429 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4299425a-9143-46c1-928a-0ef80a363c71 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:01.565869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4299425a-9143-46c1-928a-0ef80a363c71 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:01.566632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4299425a-9143-46c1-928a-0ef80a363c71 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:01.567065 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4299425a-9143-46c1-928a-0ef80a363c71 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:01.671274 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4299425a-9143-46c1-928a-0ef80a363c71 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 27906 microversion: 2.1 time: 0.118944 Dec 24 05:16:01.671973 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 768/1461] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:01 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 27906 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:02.690566 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-7241fd90-7b3b-4bb9-98d4-58a9d19fff85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:02.692076 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-7241fd90-7b3b-4bb9-98d4-58a9d19fff85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:02.702468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7241fd90-7b3b-4bb9-98d4-58a9d19fff85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:02.702914 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7241fd90-7b3b-4bb9-98d4-58a9d19fff85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:02.703701 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7241fd90-7b3b-4bb9-98d4-58a9d19fff85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:02.704122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-7241fd90-7b3b-4bb9-98d4-58a9d19fff85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:02.798475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-7241fd90-7b3b-4bb9-98d4-58a9d19fff85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.115171 Dec 24 05:16:02.799472 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 694/1462] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:02 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:03.816848 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-283f36a7-1296-440e-8802-7d1d7100ed81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:03.818484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-283f36a7-1296-440e-8802-7d1d7100ed81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:03.827802 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-283f36a7-1296-440e-8802-7d1d7100ed81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:03.828249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-283f36a7-1296-440e-8802-7d1d7100ed81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:03.829032 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-283f36a7-1296-440e-8802-7d1d7100ed81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:03.829460 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-283f36a7-1296-440e-8802-7d1d7100ed81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:03.915677 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-283f36a7-1296-440e-8802-7d1d7100ed81 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.105169 Dec 24 05:16:03.916593 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 769/1463] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:03 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:04.933539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c14be726-1771-4cc9-a9e1-d1b3dd34060c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:04.935200 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c14be726-1771-4cc9-a9e1-d1b3dd34060c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:04.946588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c14be726-1771-4cc9-a9e1-d1b3dd34060c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:04.947317 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c14be726-1771-4cc9-a9e1-d1b3dd34060c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:04.948592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c14be726-1771-4cc9-a9e1-d1b3dd34060c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:04.949395 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c14be726-1771-4cc9-a9e1-d1b3dd34060c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:05.039632 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c14be726-1771-4cc9-a9e1-d1b3dd34060c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.112908 Dec 24 05:16:05.040482 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 695/1464] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:04 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:06.058125 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a23d08a5-8ddc-4f34-8091-71618db2e4fe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:06.058984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a23d08a5-8ddc-4f34-8091-71618db2e4fe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:06.066298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a23d08a5-8ddc-4f34-8091-71618db2e4fe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:06.066738 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a23d08a5-8ddc-4f34-8091-71618db2e4fe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:06.067520 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a23d08a5-8ddc-4f34-8091-71618db2e4fe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:06.067941 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a23d08a5-8ddc-4f34-8091-71618db2e4fe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:06.162072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a23d08a5-8ddc-4f34-8091-71618db2e4fe tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.110977 Dec 24 05:16:06.163127 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 770/1465] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:06 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:07.180994 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-502c6fcd-ecd7-4fda-a4ed-93ea20fd3859 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:07.182599 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-502c6fcd-ecd7-4fda-a4ed-93ea20fd3859 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:07.194633 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-502c6fcd-ecd7-4fda-a4ed-93ea20fd3859 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:07.195368 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-502c6fcd-ecd7-4fda-a4ed-93ea20fd3859 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:07.196674 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-502c6fcd-ecd7-4fda-a4ed-93ea20fd3859 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:07.197392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-502c6fcd-ecd7-4fda-a4ed-93ea20fd3859 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:07.292925 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-502c6fcd-ecd7-4fda-a4ed-93ea20fd3859 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.117968 Dec 24 05:16:07.294054 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 696/1466] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:07 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:08.311018 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7487cabd-889f-4594-9909-43fdd4756556 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:08.311945 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7487cabd-889f-4594-9909-43fdd4756556 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:08.318851 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7487cabd-889f-4594-9909-43fdd4756556 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:08.319707 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7487cabd-889f-4594-9909-43fdd4756556 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:08.320071 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7487cabd-889f-4594-9909-43fdd4756556 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:08.320519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7487cabd-889f-4594-9909-43fdd4756556 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:08.404989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7487cabd-889f-4594-9909-43fdd4756556 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.099092 Dec 24 05:16:08.406000 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 771/1467] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:08 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:09.422468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8124a85b-381f-4553-be73-17f04ed685bd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:09.423690 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-8124a85b-381f-4553-be73-17f04ed685bd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:09.432490 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8124a85b-381f-4553-be73-17f04ed685bd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:09.433087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8124a85b-381f-4553-be73-17f04ed685bd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:09.434147 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8124a85b-381f-4553-be73-17f04ed685bd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:09.434680 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-8124a85b-381f-4553-be73-17f04ed685bd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:09.525098 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8124a85b-381f-4553-be73-17f04ed685bd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.107424 Dec 24 05:16:09.525876 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 697/1468] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:09 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:10.542168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-65055181-ebfb-4220-97ac-23d9c43311b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:10.543423 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-65055181-ebfb-4220-97ac-23d9c43311b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:10.553908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65055181-ebfb-4220-97ac-23d9c43311b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:10.554562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65055181-ebfb-4220-97ac-23d9c43311b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:10.555787 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65055181-ebfb-4220-97ac-23d9c43311b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:10.556424 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-65055181-ebfb-4220-97ac-23d9c43311b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:10.647358 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-65055181-ebfb-4220-97ac-23d9c43311b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.111091 Dec 24 05:16:10.648254 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 772/1469] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:10 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:11.668939 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-66e06083-3be4-4a47-889e-6181b2d5706e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:11.670274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-66e06083-3be4-4a47-889e-6181b2d5706e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:11.681649 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66e06083-3be4-4a47-889e-6181b2d5706e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:11.682386 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66e06083-3be4-4a47-889e-6181b2d5706e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:11.683821 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66e06083-3be4-4a47-889e-6181b2d5706e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:11.684426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-66e06083-3be4-4a47-889e-6181b2d5706e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:11.769420 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-66e06083-3be4-4a47-889e-6181b2d5706e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.107610 Dec 24 05:16:11.770274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 698/1470] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:11 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:12.787595 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-14336ebe-3bb5-46ed-99e3-ec344a1bd4a9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:12.789318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-14336ebe-3bb5-46ed-99e3-ec344a1bd4a9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:12.798291 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14336ebe-3bb5-46ed-99e3-ec344a1bd4a9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:12.798778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14336ebe-3bb5-46ed-99e3-ec344a1bd4a9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:12.799540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14336ebe-3bb5-46ed-99e3-ec344a1bd4a9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:12.799963 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-14336ebe-3bb5-46ed-99e3-ec344a1bd4a9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:12.882496 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-14336ebe-3bb5-46ed-99e3-ec344a1bd4a9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.101619 Dec 24 05:16:12.883145 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 773/1471] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:12 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:13.900930 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2a7db140-f7eb-4a36-95c0-7dd3eb3afa1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:13.902574 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2a7db140-f7eb-4a36-95c0-7dd3eb3afa1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:13.910106 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a7db140-f7eb-4a36-95c0-7dd3eb3afa1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:13.910543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a7db140-f7eb-4a36-95c0-7dd3eb3afa1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:13.911312 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a7db140-f7eb-4a36-95c0-7dd3eb3afa1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:13.911732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2a7db140-f7eb-4a36-95c0-7dd3eb3afa1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:14.001565 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2a7db140-f7eb-4a36-95c0-7dd3eb3afa1c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28202 microversion: 2.1 time: 0.106961 Dec 24 05:16:14.002496 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 699/1472] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:13 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:15.017064 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3e2a7101-1d2e-4fda-bfba-f176bffc0450 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:15.018616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3e2a7101-1d2e-4fda-bfba-f176bffc0450 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:15.029308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2a7101-1d2e-4fda-bfba-f176bffc0450 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:15.029987 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2a7101-1d2e-4fda-bfba-f176bffc0450 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:15.031214 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2a7101-1d2e-4fda-bfba-f176bffc0450 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:15.031868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3e2a7101-1d2e-4fda-bfba-f176bffc0450 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:15.127722 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3e2a7101-1d2e-4fda-bfba-f176bffc0450 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28493 microversion: 2.1 time: 0.116160 Dec 24 05:16:15.128765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 774/1473] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:15 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28493 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:16.146375 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-74e50e07-6574-4ded-a255-a4e1b2b679e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:16.147979 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-74e50e07-6574-4ded-a255-a4e1b2b679e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:16.156774 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74e50e07-6574-4ded-a255-a4e1b2b679e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:16.157213 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74e50e07-6574-4ded-a255-a4e1b2b679e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:16.157991 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74e50e07-6574-4ded-a255-a4e1b2b679e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:16.158409 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-74e50e07-6574-4ded-a255-a4e1b2b679e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:16.250973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-74e50e07-6574-4ded-a255-a4e1b2b679e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28493 microversion: 2.1 time: 0.110958 Dec 24 05:16:16.251990 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 700/1474] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:16 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28493 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:17.271988 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9c8c0872-b205-49f9-9797-6823845a46e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:17.273798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9c8c0872-b205-49f9-9797-6823845a46e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:17.287675 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c8c0872-b205-49f9-9797-6823845a46e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:17.288410 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c8c0872-b205-49f9-9797-6823845a46e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:17.289908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c8c0872-b205-49f9-9797-6823845a46e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:17.290623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9c8c0872-b205-49f9-9797-6823845a46e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:17.394069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9c8c0872-b205-49f9-9797-6823845a46e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.129955 Dec 24 05:16:17.395062 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 775/1475] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:17 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:18.412441 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d6f7803b-966b-412b-9ee2-79fdd0ff7174 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:18.413742 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d6f7803b-966b-412b-9ee2-79fdd0ff7174 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:18.424866 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6f7803b-966b-412b-9ee2-79fdd0ff7174 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:18.425494 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6f7803b-966b-412b-9ee2-79fdd0ff7174 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:18.426670 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6f7803b-966b-412b-9ee2-79fdd0ff7174 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:18.427288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6f7803b-966b-412b-9ee2-79fdd0ff7174 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:18.518928 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d6f7803b-966b-412b-9ee2-79fdd0ff7174 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.112739 Dec 24 05:16:18.519944 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 701/1476] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:18 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 24 05:16:19.538407 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b75a82ae-e541-4598-9fbf-63ec5afdb3e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:19.540056 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b75a82ae-e541-4598-9fbf-63ec5afdb3e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:19.548717 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b75a82ae-e541-4598-9fbf-63ec5afdb3e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:19.549193 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b75a82ae-e541-4598-9fbf-63ec5afdb3e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:19.549950 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b75a82ae-e541-4598-9fbf-63ec5afdb3e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:19.550377 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b75a82ae-e541-4598-9fbf-63ec5afdb3e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:19.635302 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b75a82ae-e541-4598-9fbf-63ec5afdb3e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.103092 Dec 24 05:16:19.636195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 776/1477] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:19 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:20.654492 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-bc0a8b66-2e38-4c05-b83c-408310180d34 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:20.655471 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-bc0a8b66-2e38-4c05-b83c-408310180d34 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:20.663035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b66-2e38-4c05-b83c-408310180d34 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:20.663504 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b66-2e38-4c05-b83c-408310180d34 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:20.664311 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b66-2e38-4c05-b83c-408310180d34 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:20.664883 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-bc0a8b66-2e38-4c05-b83c-408310180d34 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:20.753773 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-bc0a8b66-2e38-4c05-b83c-408310180d34 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.106200 Dec 24 05:16:20.754555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 702/1478] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:20 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:21.771413 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0a199b29-748d-458d-9faf-ff5d6b66e022 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:21.773002 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0a199b29-748d-458d-9faf-ff5d6b66e022 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:21.784871 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a199b29-748d-458d-9faf-ff5d6b66e022 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:21.785616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a199b29-748d-458d-9faf-ff5d6b66e022 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:21.786916 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a199b29-748d-458d-9faf-ff5d6b66e022 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:21.787611 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0a199b29-748d-458d-9faf-ff5d6b66e022 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:21.885036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0a199b29-748d-458d-9faf-ff5d6b66e022 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.119936 Dec 24 05:16:21.886054 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 777/1479] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:21 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:22.904837 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-29a1a349-0b53-4332-9e16-ec7d274d75ab tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:22.905845 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-29a1a349-0b53-4332-9e16-ec7d274d75ab tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:22.913247 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29a1a349-0b53-4332-9e16-ec7d274d75ab tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:22.913692 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29a1a349-0b53-4332-9e16-ec7d274d75ab tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:22.914464 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29a1a349-0b53-4332-9e16-ec7d274d75ab tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:22.914890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-29a1a349-0b53-4332-9e16-ec7d274d75ab tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:23.013745 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-29a1a349-0b53-4332-9e16-ec7d274d75ab tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.114943 Dec 24 05:16:23.014456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 703/1480] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:22 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:24.027883 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bfa93d5e-bd66-4621-be8f-9e84c1dd1eed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:24.029271 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bfa93d5e-bd66-4621-be8f-9e84c1dd1eed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:24.036298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfa93d5e-bd66-4621-be8f-9e84c1dd1eed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:24.036775 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfa93d5e-bd66-4621-be8f-9e84c1dd1eed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:24.037547 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfa93d5e-bd66-4621-be8f-9e84c1dd1eed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:24.037970 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bfa93d5e-bd66-4621-be8f-9e84c1dd1eed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:24.123582 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bfa93d5e-bd66-4621-be8f-9e84c1dd1eed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.100412 Dec 24 05:16:24.124392 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 778/1481] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:24 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:25.141087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-91078a80-6b2a-4d0c-a2b4-c18c0aa4d9fb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:25.142085 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-91078a80-6b2a-4d0c-a2b4-c18c0aa4d9fb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:25.150468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91078a80-6b2a-4d0c-a2b4-c18c0aa4d9fb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:25.150910 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91078a80-6b2a-4d0c-a2b4-c18c0aa4d9fb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:25.151686 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91078a80-6b2a-4d0c-a2b4-c18c0aa4d9fb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:25.152110 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-91078a80-6b2a-4d0c-a2b4-c18c0aa4d9fb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:25.241090 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-91078a80-6b2a-4d0c-a2b4-c18c0aa4d9fb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.106923 Dec 24 05:16:25.241743 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 704/1482] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:25 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:26.257723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ba2c6c0f-a356-4a34-9c87-6c9b53123f76 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:26.259323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ba2c6c0f-a356-4a34-9c87-6c9b53123f76 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:26.268165 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c0f-a356-4a34-9c87-6c9b53123f76 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:26.268632 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c0f-a356-4a34-9c87-6c9b53123f76 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:26.269393 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c0f-a356-4a34-9c87-6c9b53123f76 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:26.269812 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c0f-a356-4a34-9c87-6c9b53123f76 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:26.375831 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ba2c6c0f-a356-4a34-9c87-6c9b53123f76 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.124254 Dec 24 05:16:26.376739 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 779/1483] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:26 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:27.393039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3d3539e3-4e78-4b87-ad10-16f52e9540d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:27.394097 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3d3539e3-4e78-4b87-ad10-16f52e9540d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:27.401603 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d3539e3-4e78-4b87-ad10-16f52e9540d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:27.402072 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d3539e3-4e78-4b87-ad10-16f52e9540d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:27.402889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d3539e3-4e78-4b87-ad10-16f52e9540d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:27.403343 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d3539e3-4e78-4b87-ad10-16f52e9540d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:27.488096 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3d3539e3-4e78-4b87-ad10-16f52e9540d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.099510 Dec 24 05:16:27.489578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 705/1484] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:27 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:28.502464 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-7c5c71bd-c0b7-428b-b277-c19dd3705b50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:28.503463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-7c5c71bd-c0b7-428b-b277-c19dd3705b50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:28.510752 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c5c71bd-c0b7-428b-b277-c19dd3705b50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:28.511188 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c5c71bd-c0b7-428b-b277-c19dd3705b50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:28.511954 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c5c71bd-c0b7-428b-b277-c19dd3705b50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:28.512380 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-7c5c71bd-c0b7-428b-b277-c19dd3705b50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:28.604182 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-7c5c71bd-c0b7-428b-b277-c19dd3705b50 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.105651 Dec 24 05:16:28.604892 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 780/1485] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:28 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:29.621376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-73dabffc-1964-4506-94f3-a2ce79b77f4a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:29.623076 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-73dabffc-1964-4506-94f3-a2ce79b77f4a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:29.630628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73dabffc-1964-4506-94f3-a2ce79b77f4a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:29.631101 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73dabffc-1964-4506-94f3-a2ce79b77f4a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:29.631883 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73dabffc-1964-4506-94f3-a2ce79b77f4a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:29.632309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-73dabffc-1964-4506-94f3-a2ce79b77f4a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:29.717515 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-73dabffc-1964-4506-94f3-a2ce79b77f4a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.102258 Dec 24 05:16:29.718706 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 706/1486] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:29 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:30.736066 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2160d1bc-9d26-41fd-abde-2549a0066c9d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:30.737087 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2160d1bc-9d26-41fd-abde-2549a0066c9d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:30.744180 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2160d1bc-9d26-41fd-abde-2549a0066c9d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:30.744731 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2160d1bc-9d26-41fd-abde-2549a0066c9d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:30.745500 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2160d1bc-9d26-41fd-abde-2549a0066c9d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:30.745936 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2160d1bc-9d26-41fd-abde-2549a0066c9d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:30.836545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2160d1bc-9d26-41fd-abde-2549a0066c9d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.105743 Dec 24 05:16:30.837577 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 781/1487] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:30 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:31.855589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5578798c-83cf-4e45-97e4-92bf5fb2c5eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:31.857235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5578798c-83cf-4e45-97e4-92bf5fb2c5eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:31.865191 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5578798c-83cf-4e45-97e4-92bf5fb2c5eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:31.865628 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5578798c-83cf-4e45-97e4-92bf5fb2c5eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:31.866392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5578798c-83cf-4e45-97e4-92bf5fb2c5eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:31.866812 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5578798c-83cf-4e45-97e4-92bf5fb2c5eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:31.971966 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5578798c-83cf-4e45-97e4-92bf5fb2c5eb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.122542 Dec 24 05:16:31.973047 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 707/1488] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:31 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:32.991964 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-33bebc63-e647-43b7-bdd0-3a842e50e04d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:32.993685 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-33bebc63-e647-43b7-bdd0-3a842e50e04d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:33.004135 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33bebc63-e647-43b7-bdd0-3a842e50e04d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:33.004711 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33bebc63-e647-43b7-bdd0-3a842e50e04d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:33.005671 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33bebc63-e647-43b7-bdd0-3a842e50e04d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:33.006198 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-33bebc63-e647-43b7-bdd0-3a842e50e04d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:33.109298 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-33bebc63-e647-43b7-bdd0-3a842e50e04d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.124664 Dec 24 05:16:33.110122 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 782/1489] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:32 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:34.126255 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-80270117-4675-4fca-9369-2e2bc516d05c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:34.127880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-80270117-4675-4fca-9369-2e2bc516d05c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:34.139306 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80270117-4675-4fca-9369-2e2bc516d05c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:34.140076 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80270117-4675-4fca-9369-2e2bc516d05c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:34.141425 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80270117-4675-4fca-9369-2e2bc516d05c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:34.142065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-80270117-4675-4fca-9369-2e2bc516d05c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:34.227771 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-80270117-4675-4fca-9369-2e2bc516d05c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.108144 Dec 24 05:16:34.228589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 708/1490] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:34 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:35.244483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9d025ec9-ae8a-4b26-994b-ff3cc4b124c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:35.246143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9d025ec9-ae8a-4b26-994b-ff3cc4b124c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:35.255195 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d025ec9-ae8a-4b26-994b-ff3cc4b124c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:35.255633 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d025ec9-ae8a-4b26-994b-ff3cc4b124c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:35.256399 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d025ec9-ae8a-4b26-994b-ff3cc4b124c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:35.256855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9d025ec9-ae8a-4b26-994b-ff3cc4b124c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:35.340074 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9d025ec9-ae8a-4b26-994b-ff3cc4b124c7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.102221 Dec 24 05:16:35.340740 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 783/1491] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:35 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:36.356175 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-141eec97-0f3c-466d-b2cc-270c79a681c6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:36.357352 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-141eec97-0f3c-466d-b2cc-270c79a681c6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:36.366112 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-141eec97-0f3c-466d-b2cc-270c79a681c6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:36.366554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-141eec97-0f3c-466d-b2cc-270c79a681c6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:36.367328 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-141eec97-0f3c-466d-b2cc-270c79a681c6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:36.367754 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-141eec97-0f3c-466d-b2cc-270c79a681c6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:36.450326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-141eec97-0f3c-466d-b2cc-270c79a681c6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.100488 Dec 24 05:16:36.451183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 709/1492] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:36 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:37.467970 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-107b8479-5ad8-42d4-9d9b-2e02c13f18c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:37.469909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-107b8479-5ad8-42d4-9d9b-2e02c13f18c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:37.477204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107b8479-5ad8-42d4-9d9b-2e02c13f18c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:37.477648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107b8479-5ad8-42d4-9d9b-2e02c13f18c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:37.478427 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107b8479-5ad8-42d4-9d9b-2e02c13f18c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:37.478860 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-107b8479-5ad8-42d4-9d9b-2e02c13f18c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:37.578746 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-107b8479-5ad8-42d4-9d9b-2e02c13f18c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.117034 Dec 24 05:16:37.580484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 784/1493] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:37 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:38.598664 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6c803496-a8a2-4579-8ca4-171e93db5be4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:38.600568 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6c803496-a8a2-4579-8ca4-171e93db5be4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:38.611909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c803496-a8a2-4579-8ca4-171e93db5be4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:38.612359 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c803496-a8a2-4579-8ca4-171e93db5be4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:38.613180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c803496-a8a2-4579-8ca4-171e93db5be4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:38.613607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6c803496-a8a2-4579-8ca4-171e93db5be4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:38.710128 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6c803496-a8a2-4579-8ca4-171e93db5be4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.118290 Dec 24 05:16:38.710807 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 710/1494] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:38 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:39.727763 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-06486e45-94ee-48c4-8991-943abcd0cdc8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:39.729319 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-06486e45-94ee-48c4-8991-943abcd0cdc8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:39.741321 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06486e45-94ee-48c4-8991-943abcd0cdc8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:39.742051 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06486e45-94ee-48c4-8991-943abcd0cdc8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:39.743318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06486e45-94ee-48c4-8991-943abcd0cdc8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:39.744029 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-06486e45-94ee-48c4-8991-943abcd0cdc8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:39.836405 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-06486e45-94ee-48c4-8991-943abcd0cdc8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.116010 Dec 24 05:16:39.837478 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 785/1495] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:39 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:40.853149 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-078ea12f-bf3d-4f82-a7fd-156290993015 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:40.854330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-078ea12f-bf3d-4f82-a7fd-156290993015 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:40.863589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-078ea12f-bf3d-4f82-a7fd-156290993015 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:40.864023 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-078ea12f-bf3d-4f82-a7fd-156290993015 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:40.864820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-078ea12f-bf3d-4f82-a7fd-156290993015 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:40.865244 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-078ea12f-bf3d-4f82-a7fd-156290993015 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:40.950723 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-078ea12f-bf3d-4f82-a7fd-156290993015 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.102592 Dec 24 05:16:40.951594 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 711/1496] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:40 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:41.969068 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f1ff31cb-c826-40d7-a4fe-a590df65038c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:41.970996 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f1ff31cb-c826-40d7-a4fe-a590df65038c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:41.978662 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1ff31cb-c826-40d7-a4fe-a590df65038c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:41.979133 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1ff31cb-c826-40d7-a4fe-a590df65038c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:41.979943 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1ff31cb-c826-40d7-a4fe-a590df65038c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:41.980394 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f1ff31cb-c826-40d7-a4fe-a590df65038c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:42.068398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f1ff31cb-c826-40d7-a4fe-a590df65038c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.105535 Dec 24 05:16:42.069472 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 786/1497] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:41 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:43.088129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4475bbe1-d6cf-4228-abe0-408083edd4e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:43.089716 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4475bbe1-d6cf-4228-abe0-408083edd4e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:43.100780 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4475bbe1-d6cf-4228-abe0-408083edd4e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:43.101511 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4475bbe1-d6cf-4228-abe0-408083edd4e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:43.102775 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4475bbe1-d6cf-4228-abe0-408083edd4e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:43.103478 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4475bbe1-d6cf-4228-abe0-408083edd4e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:43.199167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4475bbe1-d6cf-4228-abe0-408083edd4e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.117698 Dec 24 05:16:43.199953 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 712/1498] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:43 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:44.217926 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-b57c55da-17f5-464b-bd53-bbb0a92e6037 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:44.219546 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-b57c55da-17f5-464b-bd53-bbb0a92e6037 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:44.227522 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b57c55da-17f5-464b-bd53-bbb0a92e6037 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:44.227965 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b57c55da-17f5-464b-bd53-bbb0a92e6037 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:44.228849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b57c55da-17f5-464b-bd53-bbb0a92e6037 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:44.229186 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-b57c55da-17f5-464b-bd53-bbb0a92e6037 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:44.325099 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-b57c55da-17f5-464b-bd53-bbb0a92e6037 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 28661 microversion: 2.1 time: 0.113357 Dec 24 05:16:44.325913 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 787/1499] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:44 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 28661 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:45.338197 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-858801f3-e433-411f-9df6-d26a1f37752f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:45.339203 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-858801f3-e433-411f-9df6-d26a1f37752f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:45.346711 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-858801f3-e433-411f-9df6-d26a1f37752f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:45.347152 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-858801f3-e433-411f-9df6-d26a1f37752f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:45.347922 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-858801f3-e433-411f-9df6-d26a1f37752f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:45.348350 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-858801f3-e433-411f-9df6-d26a1f37752f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:45.451476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-858801f3-e433-411f-9df6-d26a1f37752f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 30961 microversion: 2.1 time: 0.116750 Dec 24 05:16:45.452477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 713/1500] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:45 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 30961 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:46.470149 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-49c5605c-ccc5-4556-9ab8-c23941239d48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:46.471075 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-49c5605c-ccc5-4556-9ab8-c23941239d48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:46.478313 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49c5605c-ccc5-4556-9ab8-c23941239d48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:46.478760 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49c5605c-ccc5-4556-9ab8-c23941239d48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:46.479534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49c5605c-ccc5-4556-9ab8-c23941239d48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:46.479960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-49c5605c-ccc5-4556-9ab8-c23941239d48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:46.574528 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-49c5605c-ccc5-4556-9ab8-c23941239d48 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 32992 microversion: 2.1 time: 0.110978 Dec 24 05:16:46.575529 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 788/1501] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:46 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 32992 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:47.594304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6bc1bd1c-c10d-4dec-919e-9ccd1ef15529 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:47.596274 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6bc1bd1c-c10d-4dec-919e-9ccd1ef15529 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:47.609436 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1c-c10d-4dec-919e-9ccd1ef15529 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:47.610229 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1c-c10d-4dec-919e-9ccd1ef15529 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:47.611586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1c-c10d-4dec-919e-9ccd1ef15529 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:47.612066 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6bc1bd1c-c10d-4dec-919e-9ccd1ef15529 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:47.710495 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6bc1bd1c-c10d-4dec-919e-9ccd1ef15529 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 34068 microversion: 2.1 time: 0.122666 Dec 24 05:16:47.711505 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 714/1502] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:47 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 34068 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:48.726708 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-d8bc930a-1169-4050-b828-ce1b99e6fa02 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:48.727719 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-d8bc930a-1169-4050-b828-ce1b99e6fa02 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:48.735096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8bc930a-1169-4050-b828-ce1b99e6fa02 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:48.735543 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8bc930a-1169-4050-b828-ce1b99e6fa02 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:48.736322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8bc930a-1169-4050-b828-ce1b99e6fa02 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:48.736807 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-d8bc930a-1169-4050-b828-ce1b99e6fa02 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:48.832616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-d8bc930a-1169-4050-b828-ce1b99e6fa02 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 35303 microversion: 2.1 time: 0.109517 Dec 24 05:16:48.834102 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 789/1503] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:48 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 35303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:49.853739 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-df0194c9-c736-42f5-924e-c61bb54ca678 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:49.855357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-df0194c9-c736-42f5-924e-c61bb54ca678 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:49.865239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df0194c9-c736-42f5-924e-c61bb54ca678 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:49.865677 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df0194c9-c736-42f5-924e-c61bb54ca678 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:49.866448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df0194c9-c736-42f5-924e-c61bb54ca678 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:49.866941 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-df0194c9-c736-42f5-924e-c61bb54ca678 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:49.977681 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-df0194c9-c736-42f5-924e-c61bb54ca678 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 36834 microversion: 2.1 time: 0.130722 Dec 24 05:16:49.978320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 715/1504] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:49 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 36834 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:50.996212 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9e4280c7-8c5d-450d-b9b1-d53a41c0ee3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:50.997869 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9e4280c7-8c5d-450d-b9b1-d53a41c0ee3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:51.006715 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9e4280c7-8c5d-450d-b9b1-d53a41c0ee3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:51.007182 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9e4280c7-8c5d-450d-b9b1-d53a41c0ee3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:51.007986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9e4280c7-8c5d-450d-b9b1-d53a41c0ee3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:51.008428 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9e4280c7-8c5d-450d-b9b1-d53a41c0ee3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:51.107767 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9e4280c7-8c5d-450d-b9b1-d53a41c0ee3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 38187 microversion: 2.1 time: 0.119198 Dec 24 05:16:51.108834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 790/1505] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:50 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 38187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:52.123428 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a16014ba-6356-4ebd-878c-95c7442925b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:52.124468 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a16014ba-6356-4ebd-878c-95c7442925b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:52.133626 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a16014ba-6356-4ebd-878c-95c7442925b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:52.134363 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a16014ba-6356-4ebd-878c-95c7442925b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:52.135157 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a16014ba-6356-4ebd-878c-95c7442925b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:52.135589 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a16014ba-6356-4ebd-878c-95c7442925b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:52.222949 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a16014ba-6356-4ebd-878c-95c7442925b5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 38187 microversion: 2.1 time: 0.103081 Dec 24 05:16:52.223979 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 716/1506] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:52 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 38187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:53.240759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2399c23e-0788-446f-8a7a-3684064255a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:53.242069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2399c23e-0788-446f-8a7a-3684064255a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:53.252011 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2399c23e-0788-446f-8a7a-3684064255a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:53.252483 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2399c23e-0788-446f-8a7a-3684064255a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:53.253293 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2399c23e-0788-446f-8a7a-3684064255a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:53.253730 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2399c23e-0788-446f-8a7a-3684064255a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:53.337795 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2399c23e-0788-446f-8a7a-3684064255a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 38187 microversion: 2.1 time: 0.102837 Dec 24 05:16:53.338602 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 791/1507] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:53 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 38187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:54.353264 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1cef0bdc-4add-41b8-b10a-844c492a0feb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:54.354196 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1cef0bdc-4add-41b8-b10a-844c492a0feb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:54.361543 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1cef0bdc-4add-41b8-b10a-844c492a0feb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:54.361985 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1cef0bdc-4add-41b8-b10a-844c492a0feb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:54.362762 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1cef0bdc-4add-41b8-b10a-844c492a0feb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:54.363189 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1cef0bdc-4add-41b8-b10a-844c492a0feb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:54.448105 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1cef0bdc-4add-41b8-b10a-844c492a0feb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 38187 microversion: 2.1 time: 0.098476 Dec 24 05:16:54.449138 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 717/1508] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:54 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 38187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:55.468895 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9f80192f-a26e-48c4-b90b-1be3c5a87a18 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:55.470475 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9f80192f-a26e-48c4-b90b-1be3c5a87a18 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:55.478690 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f80192f-a26e-48c4-b90b-1be3c5a87a18 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:55.479131 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f80192f-a26e-48c4-b90b-1be3c5a87a18 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:55.479909 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f80192f-a26e-48c4-b90b-1be3c5a87a18 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:55.480342 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9f80192f-a26e-48c4-b90b-1be3c5a87a18 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:55.577448 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9f80192f-a26e-48c4-b90b-1be3c5a87a18 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action" status: 200 len: 38318 microversion: 2.1 time: 0.114742 Dec 24 05:16:55.578318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 792/1509] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:16:55 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/action => generated 38318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 24 05:16:55.594411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-393d194a-86e4-4c9f-bf56-f219a6d0e8e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:16:55.595281 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-393d194a-86e4-4c9f-bf56-f219a6d0e8e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:55.603035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-393d194a-86e4-4c9f-bf56-f219a6d0e8e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:55.603473 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-393d194a-86e4-4c9f-bf56-f219a6d0e8e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:55.604253 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-393d194a-86e4-4c9f-bf56-f219a6d0e8e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:55.604707 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-393d194a-86e4-4c9f-bf56-f219a6d0e8e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:55.629439 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-393d194a-86e4-4c9f-bf56-f219a6d0e8e0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/ips" status: 200 len: 146 microversion: 2.1 time: 0.041162 Dec 24 05:16:55.630009 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 718/1510] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Dec 24 05:16:55 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:16:56.944086 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f761f0c6-a5b3-4057-8507-48fabb7ca1ba tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a474202-ec75-426b-b8e0-177d58018105"}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:16:56.945251 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f761f0c6-a5b3-4057-8507-48fabb7ca1ba tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:16:56.952609 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f761f0c6-a5b3-4057-8507-48fabb7ca1ba tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:56.953072 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f761f0c6-a5b3-4057-8507-48fabb7ca1ba tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:56.953837 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f761f0c6-a5b3-4057-8507-48fabb7ca1ba tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:16:56.954260 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f761f0c6-a5b3-4057-8507-48fabb7ca1ba tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:16:57.244476 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f761f0c6-a5b3-4057-8507-48fabb7ca1ba tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304364 Dec 24 05:16:57.245172 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 793/1511] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:16:56 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:04.750732 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ff813800-62bd-4005-aadb-290b18667835 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:04.751807 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ff813800-62bd-4005-aadb-290b18667835 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:04.758998 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff813800-62bd-4005-aadb-290b18667835 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:04.759433 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff813800-62bd-4005-aadb-290b18667835 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:04.760204 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff813800-62bd-4005-aadb-290b18667835 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:04.762126 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ff813800-62bd-4005-aadb-290b18667835 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:04.793034 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ff813800-62bd-4005-aadb-290b18667835 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Dec 24 05:17:04.793591 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 719/1512] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:17:04 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:04.804688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-64f014a6-0f39-4c96-a9e9-2175c1942ecd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:04.805267 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-64f014a6-0f39-4c96-a9e9-2175c1942ecd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:04.812010 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64f014a6-0f39-4c96-a9e9-2175c1942ecd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:04.812450 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64f014a6-0f39-4c96-a9e9-2175c1942ecd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:04.813257 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64f014a6-0f39-4c96-a9e9-2175c1942ecd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:04.813686 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-64f014a6-0f39-4c96-a9e9-2175c1942ecd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:04.842453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-64f014a6-0f39-4c96-a9e9-2175c1942ecd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/6a474202-ec75-426b-b8e0-177d58018105" status: 200 len: 194 microversion: 2.1 time: 0.042493 Dec 24 05:17:04.843020 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 794/1513] 10.222.0.43 () {58 vars in 1412 bytes} [Fri Dec 24 05:17:04 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/6a474202-ec75-426b-b8e0-177d58018105 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:06.171598 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3585654d-817b-4d93-94f8-49427ed3c19a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92888d56-a2cd-4732-aeef-14cd019ddacb"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:17:06.173035 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3585654d-817b-4d93-94f8-49427ed3c19a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:06.181691 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3585654d-817b-4d93-94f8-49427ed3c19a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:06.182129 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3585654d-817b-4d93-94f8-49427ed3c19a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:06.182901 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3585654d-817b-4d93-94f8-49427ed3c19a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:06.183325 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3585654d-817b-4d93-94f8-49427ed3c19a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:06.445892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3585654d-817b-4d93-94f8-49427ed3c19a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280100 Dec 24 05:17:06.446505 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 720/1514] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Dec 24 05:17:06 2021] POST /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:13.998316 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4a494ac2-d164-4a0e-a167-19974e52acf3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:13.999229 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4a494ac2-d164-4a0e-a167-19974e52acf3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:14.005897 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a494ac2-d164-4a0e-a167-19974e52acf3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:14.006349 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a494ac2-d164-4a0e-a167-19974e52acf3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:14.007124 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a494ac2-d164-4a0e-a167-19974e52acf3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:14.007556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4a494ac2-d164-4a0e-a167-19974e52acf3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:14.038044 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4a494ac2-d164-4a0e-a167-19974e52acf3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044266 Dec 24 05:17:14.038596 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 795/1515] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:17:13 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:14.218604 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-0c98d225-17e5-476c-b91a-d5b4f3b865d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:14.219288 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-0c98d225-17e5-476c-b91a-d5b4f3b865d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:14.227808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c98d225-17e5-476c-b91a-d5b4f3b865d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:14.228233 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c98d225-17e5-476c-b91a-d5b4f3b865d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:14.229051 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c98d225-17e5-476c-b91a-d5b4f3b865d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:14.229475 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-0c98d225-17e5-476c-b91a-d5b4f3b865d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:14.258221 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-0c98d225-17e5-476c-b91a-d5b4f3b865d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/6a474202-ec75-426b-b8e0-177d58018105" status: 200 len: 194 microversion: 2.1 time: 0.046197 Dec 24 05:17:14.258898 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 721/1516] 10.222.0.43 () {58 vars in 1412 bytes} [Fri Dec 24 05:17:14 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/6a474202-ec75-426b-b8e0-177d58018105 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:14.268575 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:14.269069 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:14.275308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:14.275754 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:14.276509 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:14.276968 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:14.365581 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lazy-loading 'services' on Instance uuid b386bfda-4228-4be5-b718-1bd4a43bb5a6 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:17:14.443962 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ea460efc-1a50-4606-a682-75dcd1e36ec2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/6a474202-ec75-426b-b8e0-177d58018105" status: 202 len: 0 microversion: 2.1 time: 0.178994 Dec 24 05:17:14.444580 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 796/1517] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:17:14 2021] DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/6a474202-ec75-426b-b8e0-177d58018105 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:17:16.613950 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-d6382198-8037-4ee3-a7c6-cde825db9a5c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:16.614503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-d6382198-8037-4ee3-a7c6-cde825db9a5c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:16.621387 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6382198-8037-4ee3-a7c6-cde825db9a5c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:16.621836 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6382198-8037-4ee3-a7c6-cde825db9a5c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:16.622605 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6382198-8037-4ee3-a7c6-cde825db9a5c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:16.623033 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-d6382198-8037-4ee3-a7c6-cde825db9a5c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:16.652215 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-d6382198-8037-4ee3-a7c6-cde825db9a5c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/92888d56-a2cd-4732-aeef-14cd019ddacb" status: 200 len: 194 microversion: 2.1 time: 0.042114 Dec 24 05:17:16.652805 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 722/1518] 10.222.0.43 () {58 vars in 1412 bytes} [Fri Dec 24 05:17:16 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/92888d56-a2cd-4732-aeef-14cd019ddacb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:16.663494 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:16.664037 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:16.671688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:16.672114 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:16.672952 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:16.673381 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:16.779960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lazy-loading 'services' on Instance uuid b386bfda-4228-4be5-b718-1bd4a43bb5a6 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:17:16.865984 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-60ba0e30-6a40-47cd-85b7-112f08ccf582 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/92888d56-a2cd-4732-aeef-14cd019ddacb" status: 202 len: 0 microversion: 2.1 time: 0.206817 Dec 24 05:17:16.866562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 797/1519] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Dec 24 05:17:16 2021] DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments/92888d56-a2cd-4732-aeef-14cd019ddacb => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:17:18.028630 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2ab3a50e-df36-4dab-ae45-3633ddbc245b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:18.029520 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2ab3a50e-df36-4dab-ae45-3633ddbc245b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:18.036495 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ab3a50e-df36-4dab-ae45-3633ddbc245b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.036970 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ab3a50e-df36-4dab-ae45-3633ddbc245b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.037752 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ab3a50e-df36-4dab-ae45-3633ddbc245b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.038190 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2ab3a50e-df36-4dab-ae45-3633ddbc245b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.068556 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2ab3a50e-df36-4dab-ae45-3633ddbc245b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043828 Dec 24 05:17:18.069137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 723/1520] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:17:18 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:17:18.196070 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-24605ec1-00e8-4e0a-ae3b-3bb5fa63e1ed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:18.197873 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-24605ec1-00e8-4e0a-ae3b-3bb5fa63e1ed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:18.205096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24605ec1-00e8-4e0a-ae3b-3bb5fa63e1ed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.205540 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24605ec1-00e8-4e0a-ae3b-3bb5fa63e1ed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.206317 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24605ec1-00e8-4e0a-ae3b-3bb5fa63e1ed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.206744 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-24605ec1-00e8-4e0a-ae3b-3bb5fa63e1ed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.238251 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-24605ec1-00e8-4e0a-ae3b-3bb5fa63e1ed tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049979 Dec 24 05:17:18.238803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 798/1521] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Dec 24 05:17:18 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 24 05:17:18.294029 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:18.294527 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:18.300906 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.301348 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.302122 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.302552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.331304 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:17:18.419102 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-6f454788-d131-4df9-927d-acd323fffb03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 204 len: 0 microversion: 2.1 time: 0.128485 Dec 24 05:17:18.419973 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 724/1522] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:17:18 2021] DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:17:18.428535 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:18.429178 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:18.435112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.435554 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.436320 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:18.436772 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:18.579259 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:17:18.587309 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1675 microversion: 2.1 time: 0.162304 Dec 24 05:17:18.588036 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 799/1523] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:17:18 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:17:19.609926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:19.610964 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:19.621942 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:19.622696 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:19.623991 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:19.624787 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:19.765302 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:17:19.772829 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1675 microversion: 2.1 time: 0.169952 Dec 24 05:17:19.773402 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 725/1524] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:17:19 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:17:20.790463 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:20.791164 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:20.797781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:20.798220 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:20.798982 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:20.799401 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:20.934059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:17:20.941408 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a56d59d8-b411-4f5d-b367-55caa06e6103 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1675 microversion: 2.1 time: 0.154642 Dec 24 05:17:20.942027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 800/1525] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:17:20 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:17:21.752634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-ba18baab-4b4e-4e2f-9768-06699147b33d req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "name": "network-vif-deleted", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:17:21.754268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:21.754268 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:17:21.767562 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-ba18baab-4b4e-4e2f-9768-06699147b33d req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:21.768239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-ba18baab-4b4e-4e2f-9768-06699147b33d req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:21.785151 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-ba18baab-4b4e-4e2f-9768-06699147b33d req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 service nova] Creating event network-vif-deleted:5dfd861f-9d99-4555-bfe9-1c8d6b3f537e for instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 on hv-cinder-81644 Dec 24 05:17:21.790622 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-ba18baab-4b4e-4e2f-9768-06699147b33d req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102954 Dec 24 05:17:21.791408 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 726/1526] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:17:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:17:21.958726 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:21.959348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:21.965992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:21.966432 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:21.967197 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:21.967622 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:21.997748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:21.998180 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:21.998614 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lazy-loading 'fault' on Instance uuid b386bfda-4228-4be5-b718-1bd4a43bb5a6 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:17:22.037325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccbafbbab7e4c358b444e4efc684a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:17:22.044853 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 200 len: 1328 microversion: 2.1 time: 0.090185 Dec 24 05:17:22.045619 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 801/1527] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:17:21 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:17:23.066499 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:23.067269 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:23.075555 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:23.076001 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:23.076819 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:23.077245 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:23.091167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] HTTP exception thrown: Instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 could not be found. Dec 24 05:17:23.091754 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Returning 404 to user: Instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:17:23.092559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4237fbd7-ac8a-44bf-81de-1374d003ba41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 404 len: 111 microversion: 2.1 time: 0.033553 Dec 24 05:17:23.093125 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 727/1528] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:17:23 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:17:23.102156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8b72f97b-170d-4f86-aa4f-2f333989f718 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '.version_select at 0x7f7baeaf3f70>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:23.123562 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8b72f97b-170d-4f86-aa4f-2f333989f718 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358616395" status: 202 len: 0 microversion: 2.1 time: 0.024887 Dec 24 05:17:23.124323 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 802/1529] 10.222.0.43 () {58 vars in 1220 bytes} [Fri Dec 24 05:17:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358616395 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:17:26.058462 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:26.059295 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:26.065915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:26.066356 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:26.067108 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:26.067529 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:26.083719 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] HTTP exception thrown: Instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 could not be found. Dec 24 05:17:26.084284 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Returning 404 to user: Instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:17:26.085118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-03aeb0a0-c1f5-44db-862f-24890bfca775 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 404 len: 111 microversion: 2.1 time: 0.030434 Dec 24 05:17:26.085635 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 728/1530] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:17:26 2021] DELETE /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:17:26.098571 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:26.099231 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: b386bfda-4228-4be5-b718-1bd4a43bb5a6] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:26.108613 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:26.109093 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:26.109868 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:26.110300 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:26.124801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] HTTP exception thrown: Instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 could not be found. Dec 24 05:17:26.125389 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Returning 404 to user: Instance b386bfda-4228-4be5-b718-1bd4a43bb5a6 could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:17:26.126204 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-9df96bd5-a38c-463f-a9c3-403c23d74c8a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6" status: 404 len: 111 microversion: 2.1 time: 0.034296 Dec 24 05:17:26.126734 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 803/1531] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:17:26 2021] GET /compute/v2.1/servers/b386bfda-4228-4be5-b718-1bd4a43bb5a6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:17:27.269668 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:27.270570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:27.279855 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:27.280303 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:27.281118 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:27.281548 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:27.295477 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] HTTP exception thrown: Instance 5096ad5d-d707-4082-908c-d12a3d5519cc could not be found. Dec 24 05:17:27.296044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Returning 404 to user: Instance 5096ad5d-d707-4082-908c-d12a3d5519cc could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:17:27.297052 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5821ebc7-7e7c-4f03-bf97-0e184de57679 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 404 len: 111 microversion: 2.1 time: 0.033475 Dec 24 05:17:27.297580 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 729/1532] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:17:27 2021] DELETE /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:17:27.305534 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:17:27.306106 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] [instance: 5096ad5d-d707-4082-908c-d12a3d5519cc] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:17:27.312740 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:27.313181 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:27.313949 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:17:27.314401 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:17:27.328138 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.wsgi [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] HTTP exception thrown: Instance 5096ad5d-d707-4082-908c-d12a3d5519cc could not be found. Dec 24 05:17:27.328748 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Returning 404 to user: Instance 5096ad5d-d707-4082-908c-d12a3d5519cc could not be found. {{(pid=116330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:17:27.329560 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8413026e-a73a-4ca2-84b6-3987bed543bc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc" status: 404 len: 111 microversion: 2.1 time: 0.027733 Dec 24 05:17:27.330096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 804/1533] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:17:27 2021] GET /compute/v2.1/servers/5096ad5d-d707-4082-908c-d12a3d5519cc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:17:33.922843 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:17:33.923372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:17:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:18:22.698092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-8aaa09d9-9c43-4907-ab0b-2698362bf156 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Action: 'create', calling method: .version_select at 0x7f7bae02e0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1151789464"}} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:18:22.713222 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8aaa09d9-9c43-4907-ab0b-2698362bf156 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Getting quotas for project 274c3c6f555f48ad93189e73c71c5ffe. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:18:22.717484 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8aaa09d9-9c43-4907-ab0b-2698362bf156 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Getting quotas for user d7d8af7dfd114b88af9b6ca9e78381fb and project 274c3c6f555f48ad93189e73c71c5ffe. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:18:22.844791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8aaa09d9-9c43-4907-ab0b-2698362bf156 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Getting quotas for project 274c3c6f555f48ad93189e73c71c5ffe. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:18:22.849570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.quota [None req-8aaa09d9-9c43-4907-ab0b-2698362bf156 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Getting quotas for user d7d8af7dfd114b88af9b6ca9e78381fb and project 274c3c6f555f48ad93189e73c71c5ffe. Resources: {'key_pairs'} {{(pid=116329) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:18:22.863227 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-8aaa09d9-9c43-4907-ab0b-2698362bf156 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.344193 Dec 24 05:18:22.863829 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 730/1534] 10.222.0.43 () {60 vars in 1157 bytes} [Fri Dec 24 05:18:22 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:18:46.464553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1019396317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1151789464", "security_groups": [{"name": "tempest-secgroup-smoke-1149674809"}], "networks": [{"uuid": "568053f6-6cfe-408d-be45-92751af5d67f"}], "block_device_mapping_v2": [{"uuid": "f1ea323b-8418-4320-9061-7ff753b576b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:18:46.582158 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.network.neutron [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] validate_networks() for [('568053f6-6cfe-408d-be45-92751af5d67f', None, None, None, None, None)] {{(pid=116330) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 24 05:18:46.953230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Flavor limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 24 05:18:46.953939 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Image limits 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 24 05:18:46.954720 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Flavor pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 24 05:18:46.955325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Image pref 0:0:0 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 24 05:18:46.956001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.virt.hardware [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116330) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 24 05:18:46.972455 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:46.972933 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:46.974033 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:46.974467 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:46.992341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Getting quotas for project 274c3c6f555f48ad93189e73c71c5ffe. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 24 05:18:46.997024 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.quota [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Getting quotas for user d7d8af7dfd114b88af9b6ca9e78381fb and project 274c3c6f555f48ad93189e73c71c5ffe. Resources: {'cores', 'ram', 'instances'} {{(pid=116330) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 24 05:18:47.067245 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Going to run 1 instances... {{(pid=116330) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 24 05:18:47.069621 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1ea323b-8418-4320-9061-7ff753b576b5',volume_size=None,volume_type=None)] {{(pid=116330) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 24 05:18:47.211142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-5c341b56-b600-41a9-848b-94ef8137d744 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751345 Dec 24 05:18:47.211778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 805/1535] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Dec 24 05:18:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 24 05:18:47.221700 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ef87eb1b-21c3-468c-92e4-5da6a7ab0d16 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:47.222353 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ef87eb1b-21c3-468c-92e4-5da6a7ab0d16 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:47.278634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-ef87eb1b-21c3-468c-92e4-5da6a7ab0d16 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:47.286394 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ef87eb1b-21c3-468c-92e4-5da6a7ab0d16 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1089 microversion: 2.1 time: 0.067986 Dec 24 05:18:47.286815 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 731/1536] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:47 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:48.304695 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:48.305180 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:48.312013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:48.312887 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:48.313997 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:48.314648 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:48.380312 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:48.387861 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1205 microversion: 2.1 time: 0.088365 Dec 24 05:18:48.388519 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 806/1537] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:48 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1205 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:49.405831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:49.406409 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:49.415391 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:49.415825 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:49.416645 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:49.417387 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:49.647087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:49.654750 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-88806b17-f434-4e28-ba52-5128136076ac tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.252765 Dec 24 05:18:49.655314 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 732/1538] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:49 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:49.988778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-86513528-2360-4ac9-837f-0de327fa5904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:18:49.991765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:18:49.991765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:18:50.001697 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-86513528-2360-4ac9-837f-0de327fa5904 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:50.004156 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-86513528-2360-4ac9-837f-0de327fa5904 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:50.018934 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-86513528-2360-4ac9-837f-0de327fa5904 service nova] Creating event network-changed:2d25cf5e-4220-4a61-99ac-a037fc92718b for instance 48617155-accf-48c5-bb2c-877a4d09e9c2 on hv-cinder-81644 Dec 24 05:18:50.025997 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-86513528-2360-4ac9-837f-0de327fa5904 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043453 Dec 24 05:18:50.026890 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 807/1539] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:18:50.672582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:50.673984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:50.681758 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:50.682197 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:50.682993 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:50.683435 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:50.883012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:50.890870 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.222438 Dec 24 05:18:50.891474 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 733/1540] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:50 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:51.913694 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:51.914553 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:51.922487 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:51.923003 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:51.923895 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:51.925059 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:52.061083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:52.068763 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-59406af3-856c-4fbf-bd8c-4e7e157deb31 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.161365 Dec 24 05:18:52.069350 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 808/1541] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:51 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:53.093605 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:53.094553 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:53.103448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:53.103898 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:53.104710 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:53.105123 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:53.251796 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:53.259476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.172050 Dec 24 05:18:53.260049 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 734/1542] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:53 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:54.279699 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:54.280658 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:54.290489 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:54.291172 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:54.292354 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:54.293053 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:54.440780 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:54.448836 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-afef3068-73bc-4bfd-a260-f53dcc069b9a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.174863 Dec 24 05:18:54.449406 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 809/1543] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:54 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:55.473173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:55.474043 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:55.482137 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:55.482580 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:55.483341 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:55.483763 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:55.625449 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:55.633957 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c21710f7-aebb-4410-9f72-aaf30eb5591f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.167022 Dec 24 05:18:55.634559 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 735/1544] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:55 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:56.655976 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:56.656584 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:56.663659 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:56.664122 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:56.664926 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:56.665343 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:56.814023 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:56.823843 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f41cf361-8595-44b1-8765-d67abd8d0c97 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.171546 Dec 24 05:18:56.824333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 810/1545] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:56 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:57.844845 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:57.845936 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:57.854712 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:57.855163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:57.855940 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:57.856374 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:57.998675 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:58.006924 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1175fbd8-142a-4fb9-ad3b-78031b580d69 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.168279 Dec 24 05:18:58.007547 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 736/1546] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:57 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:18:59.024230 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:18:59.025096 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:18:59.031967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:59.032415 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:59.033223 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:18:59.033653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:18:59.181398 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:18:59.191386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.171063 Dec 24 05:18:59.192307 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 811/1547] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:18:59 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:19:00.213006 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:19:00.213595 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:19:00.220347 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:00.220791 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:00.221577 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:00.222012 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:00.358484 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:19:00.366087 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.158715 Dec 24 05:19:00.366657 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 737/1548] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:19:00 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:19:01.383531 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:19:01.384146 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:19:01.391117 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:01.391566 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:01.392335 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:01.392801 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:01.534552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:19:01.546065 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.166355 Dec 24 05:19:01.546856 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 812/1549] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:19:01 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:19:01.801092 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-ffe9e98f-6604-4bc8-8b0c-d7fcf7ec1fca req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-plugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:19:01.802726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:19:01.802726 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:19:01.811172 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-ffe9e98f-6604-4bc8-8b0c-d7fcf7ec1fca req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:01.811856 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-ffe9e98f-6604-4bc8-8b0c-d7fcf7ec1fca req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:01.828411 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-ffe9e98f-6604-4bc8-8b0c-d7fcf7ec1fca req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 service nova] Creating event network-vif-plugged:2d25cf5e-4220-4a61-99ac-a037fc92718b for instance 48617155-accf-48c5-bb2c-877a4d09e9c2 on hv-cinder-81644 Dec 24 05:19:01.836131 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-ffe9e98f-6604-4bc8-8b0c-d7fcf7ec1fca req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096432 Dec 24 05:19:01.837065 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 738/1550] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:19:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:19:02.570981 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:19:02.571932 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:19:02.586233 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:02.586694 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:02.587479 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:02.587901 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:02.725249 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:19:02.736162 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-6b7d47a3-5332-407f-a47f-a9538c182ab2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1261 microversion: 2.1 time: 0.171236 Dec 24 05:19:02.736874 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 813/1551] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:19:02 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:19:03.756111 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:19:03.756849 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:19:03.765310 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:03.765751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:03.766503 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:03.766926 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:03.905721 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:19:03.913177 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e10e8a2b-c4f6-4909-927f-7641f135abbf tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1445 microversion: 2.1 time: 0.162815 Dec 24 05:19:03.913748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 739/1552] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:19:03 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1445 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:19:03.931168 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:19:03.931778 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:19:03.938369 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:03.938807 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:03.939572 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:03.939993 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:04.078112 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:19:04.088750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-262232e5-4d67-4f66-a802-d77907a23501 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1445 microversion: 2.1 time: 0.162780 Dec 24 05:19:04.089322 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 814/1553] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:19:03 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1445 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:19:05.877235 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-fed97848-88a2-43a3-a458-88b79a387304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:19:05.879308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:19:05.879308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:19:05.887552 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-fed97848-88a2-43a3-a458-88b79a387304 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:19:05.887989 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-fed97848-88a2-43a3-a458-88b79a387304 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:19:05.900022 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-fed97848-88a2-43a3-a458-88b79a387304 service nova] Creating event network-changed:2d25cf5e-4220-4a61-99ac-a037fc92718b for instance 48617155-accf-48c5-bb2c-877a4d09e9c2 on hv-cinder-81644 Dec 24 05:19:05.906888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-fed97848-88a2-43a3-a458-88b79a387304 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033175 Dec 24 05:19:05.910469 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 740/1554] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:19:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:20:53.933629 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:20:53.934810 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:20:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:21:19.919643 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0bf2e0f1-4507-42c1-b3ec-d30a34c9f3a7] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 24 05:21:19.923759 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:21:19.924284 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:19.931090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:19.931533 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:19.933004 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:19.933444 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:19.958100 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.objects.instance [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lazy-loading 'flavor' on Instance uuid 48617155-accf-48c5-bb2c-877a4d09e9c2 {{(pid=116330) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 24 05:21:20.045876 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.127859 Dec 24 05:21:20.046453 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 815/1555] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:21:19 2021] POST /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:21:20.053637 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b109ddec-85f4-4af1-8f4a-5df6c1cb74db] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 24 05:21:20.057703 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:20.058480 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:20.065372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:20.065859 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:20.066646 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:20.067721 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:20.261308 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:20.269417 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.217869 Dec 24 05:21:20.269974 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 741/1556] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:20 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:21.293060 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:21.294183 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:21.301992 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:21.302430 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:21.303201 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:21.303623 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:21.307120 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] [0bf2e0f1-4507-42c1-b3ec-d30a34c9f3a7] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54034. Dec 24 05:21:21.498834 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:21.506610 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-e916b21c-7216-4139-abb3-06975624e539 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.221809 Dec 24 05:21:21.507160 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 816/1557] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:21 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:22.525619 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:22.526372 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:22.535162 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:22.535602 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:22.536385 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:22.536845 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:22.563835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] [b109ddec-85f4-4af1-8f4a-5df6c1cb74db] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 54042. Dec 24 05:21:22.694414 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:22.701842 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.181251 Dec 24 05:21:22.702402 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 742/1558] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:22 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:23.723006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:23.724013 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:23.734545 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:23.735328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:23.736104 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:23.736552 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:23.887525 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:23.895469 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-700246ca-44c9-4998-935c-15bfe58fe8df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.178698 Dec 24 05:21:23.896028 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 817/1559] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:23 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:24.913865 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:24.914456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:24.921665 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:24.922114 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:24.923153 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:24.923594 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:25.073888 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:25.081639 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-4d366ab3-2073-42ee-8ef7-c9d168e44527 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.171514 Dec 24 05:21:25.082558 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 743/1560] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:24 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:26.103292 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:26.104237 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:26.114986 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:26.115723 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:26.117057 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:26.117818 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:26.271268 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:26.278960 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-1d99125b-fdd0-4633-87a2-a27310c23db6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.181834 Dec 24 05:21:26.279532 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 818/1561] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:26 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:27.299539 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:27.300280 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:27.308309 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:27.308882 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:27.309811 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:27.310330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:27.448898 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:27.456872 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-db47f963-3a1b-4260-8ced-c785c21ab9d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.162838 Dec 24 05:21:27.457779 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 744/1562] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:27 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:28.482919 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:28.483646 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:28.491121 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:28.491556 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:28.492318 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:28.492777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:28.637402 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:28.645001 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-a4015038-8682-485b-bd4b-5f233d29ce2f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.168077 Dec 24 05:21:28.645536 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 819/1563] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:28 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:29.668703 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:29.669592 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:29.677640 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:29.678085 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:29.678852 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:29.679270 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:29.820199 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:29.828465 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.166001 Dec 24 05:21:29.829081 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 745/1564] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:29 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:30.846481 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:30.847143 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:30.853983 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:30.854361 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:30.855147 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:30.855576 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:31.001927 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:31.010169 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.167915 Dec 24 05:21:31.010684 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 820/1565] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:30 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:32.033039 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:32.034029 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:32.044578 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:32.045314 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:32.046575 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:32.047298 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:32.209658 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:32.221263 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.195453 Dec 24 05:21:32.221839 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 746/1566] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:32 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:33.240395 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:33.241073 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:33.247449 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:33.247989 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:33.248793 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:33.249217 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:33.390781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:33.400635 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-df4eb139-6213-4382-bfda-a8d01d316258 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1570 microversion: 2.1 time: 0.164516 Dec 24 05:21:33.401348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 821/1567] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:33 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:33.422751 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3b905ef0-5188-4031-81d0-64ec0a495276 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:21:33.423329 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3b905ef0-5188-4031-81d0-64ec0a495276 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:33.429835 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b905ef0-5188-4031-81d0-64ec0a495276 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:33.430266 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b905ef0-5188-4031-81d0-64ec0a495276 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:33.431060 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b905ef0-5188-4031-81d0-64ec0a495276 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:33.431476 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3b905ef0-5188-4031-81d0-64ec0a495276 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:33.585359 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3b905ef0-5188-4031-81d0-64ec0a495276 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.166440 Dec 24 05:21:33.585964 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 747/1568] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Dec 24 05:21:33 2021] POST /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:21:33.593930 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:33.594575 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:33.600655 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:33.601109 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:33.601905 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:33.602798 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:33.767242 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:33.774967 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-0b2acda5-194a-4b72-956e-fd641cc691b5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1518 microversion: 2.1 time: 0.184755 Dec 24 05:21:33.775527 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 822/1569] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:33 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:34.793537 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:34.794167 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:34.800667 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:34.801132 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:34.801977 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:34.802426 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:34.940554 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:34.948880 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1520 microversion: 2.1 time: 0.160046 Dec 24 05:21:34.949506 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 748/1570] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:34 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:35.967212 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:35.967814 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:35.974208 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:35.974645 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:35.975488 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:35.975916 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:36.116565 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:36.123996 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-8731ed51-c99e-4ede-b0a6-5d340a460f93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.160580 Dec 24 05:21:36.124550 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 823/1571] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:35 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:36.585134 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-3f2dfc10-cb05-4c49-b9a5-63d5cdf43911 req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-unplugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:21:36.586820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:21:36.586820 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:21:36.596800 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-3f2dfc10-cb05-4c49-b9a5-63d5cdf43911 req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:36.597239 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-3f2dfc10-cb05-4c49-b9a5-63d5cdf43911 req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:36.608607 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-3f2dfc10-cb05-4c49-b9a5-63d5cdf43911 req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 service nova] Creating event network-vif-unplugged:2d25cf5e-4220-4a61-99ac-a037fc92718b for instance 48617155-accf-48c5-bb2c-877a4d09e9c2 on hv-cinder-81644 Dec 24 05:21:36.613808 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-3f2dfc10-cb05-4c49-b9a5-63d5cdf43911 req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032789 Dec 24 05:21:36.614609 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 749/1572] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:21:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:21:37.144849 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:37.145484 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:37.152308 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:37.152781 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:37.153577 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:37.154005 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:37.295688 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:37.303311 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-46c9cbf4-f243-43ee-93a5-8a16084d1496 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.163628 Dec 24 05:21:37.303908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 824/1573] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:37 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:38.324586 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:38.325528 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:38.334582 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:38.335357 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:38.336588 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:38.336892 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:38.490300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:38.497748 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.179626 Dec 24 05:21:38.498320 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 750/1574] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:38 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:39.516153 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:39.516789 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:39.523725 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:39.524158 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:39.524957 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:39.525376 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:39.667501 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:39.678805 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.166392 Dec 24 05:21:39.679626 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 825/1575] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:39 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:40.702456 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:40.703321 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:40.710955 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:40.711392 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:40.712508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:40.712958 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:40.848508 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:40.859817 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a3787e9d-0103-4167-9e34-1fce8063d4a8 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.162509 Dec 24 05:21:40.860570 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 751/1576] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:40 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:41.878669 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:41.879507 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:41.887777 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:41.888341 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:41.889451 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:41.890098 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:42.045797 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:42.053293 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-ae472dee-7eb5-43cd-8fca-694510e455da tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.179206 Dec 24 05:21:42.053855 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 826/1577] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:41 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:43.073403 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:43.074225 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:43.083174 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:43.083609 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:43.084371 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:43.084824 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:43.219074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:43.230909 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-88206368-dee1-4256-bd57-67ee14e1cd66 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.162655 Dec 24 05:21:43.231769 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 752/1578] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:43 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:44.253750 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:44.254386 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:44.261038 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:44.261477 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:44.262238 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:44.262665 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:44.401604 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:44.409803 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-385b832b-a526-4f3e-857e-5ec4c52c36db tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1576 microversion: 2.1 time: 0.162614 Dec 24 05:21:44.410387 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 827/1579] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:44 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:45.428025 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:21:45.428653 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:21:45.435045 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:45.435486 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:45.436257 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:45.436737 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:45.572362 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:21:45.580376 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1563 microversion: 2.1 time: 0.156245 Dec 24 05:21:45.580984 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 753/1580] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:21:45 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:21:46.694234 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-245497df-75a9-42d5-aa73-6dd634905310 req-c6b9508d-6398-49f4-a1b7-d4c816328383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-plugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:21:46.695822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:21:46.695822 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:21:46.705180 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-245497df-75a9-42d5-aa73-6dd634905310 req-c6b9508d-6398-49f4-a1b7-d4c816328383 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:21:46.705616 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-245497df-75a9-42d5-aa73-6dd634905310 req-c6b9508d-6398-49f4-a1b7-d4c816328383 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:21:46.717675 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-245497df-75a9-42d5-aa73-6dd634905310 req-c6b9508d-6398-49f4-a1b7-d4c816328383 service nova] Creating event network-vif-plugged:2d25cf5e-4220-4a61-99ac-a037fc92718b for instance 48617155-accf-48c5-bb2c-877a4d09e9c2 on hv-cinder-81644 Dec 24 05:21:46.722940 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-245497df-75a9-42d5-aa73-6dd634905310 req-c6b9508d-6398-49f4-a1b7-d4c816328383 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032571 Dec 24 05:21:46.723558 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 828/1581] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:21:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:23:01.956366 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:23:01.958027 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:23:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:23:13.286173 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:23:13.286782 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:23:13.293180 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:13.293634 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:13.294398 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:13.294831 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:13.322985 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Going to try to terminate instance {{(pid=116329) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 24 05:23:13.429074 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-a2311e16-7d26-4347-b0eb-76718d394c62 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "DELETE /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 204 len: 0 microversion: 2.1 time: 0.147505 Dec 24 05:23:13.430378 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 754/1582] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Dec 24 05:23:13 2021] DELETE /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 24 05:23:13.444044 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:23:13.445224 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:23:13.451031 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-7a31789e-8be2-458f-9b4b-0f3788c66439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]} {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:23:13.452246 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:13.452970 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:13.452970 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: warnings.warn(msg) Dec 24 05:23:13.453448 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:13.454517 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:13.455125 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:13.462518 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-7a31789e-8be2-458f-9b4b-0f3788c66439 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:13.463126 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-7a31789e-8be2-458f-9b4b-0f3788c66439 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:13.474710 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.compute.server_external_events [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-7a31789e-8be2-458f-9b4b-0f3788c66439 service nova] Creating event network-changed:2d25cf5e-4220-4a61-99ac-a037fc92718b for instance 48617155-accf-48c5-bb2c-877a4d09e9c2 on hv-cinder-81644 Dec 24 05:23:13.481273 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-7a31789e-8be2-458f-9b4b-0f3788c66439 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196687 Dec 24 05:23:13.482083 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 829/1583] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:23:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:23:13.697889 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.policy [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116329) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:23:13.705491 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1569 microversion: 2.1 time: 0.268922 Dec 24 05:23:13.706300 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 755/1584] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:23:13 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 24 05:23:14.730800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:23:14.731765 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:23:14.742304 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:14.743025 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:14.744333 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:14.745041 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:14.883891 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:23:14.892090 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-39a09789-52ab-4b00-998b-98ffc3ff14e7 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1451 microversion: 2.1 time: 0.169039 Dec 24 05:23:14.892653 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 830/1585] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:23:14 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:23:15.883326 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [req-153249fc-09ce-44be-aff6-6871ed57baf8 req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-deleted", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]} {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 24 05:23:15.884862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:15.884862 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: warnings.warn(msg) Dec 24 05:23:15.893237 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-153249fc-09ce-44be-aff6-6871ed57baf8 req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:15.894011 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [req-153249fc-09ce-44be-aff6-6871ed57baf8 req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 service nova] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:15.907770 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.compute.server_external_events [req-153249fc-09ce-44be-aff6-6871ed57baf8 req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 service nova] Creating event network-vif-deleted:2d25cf5e-4220-4a61-99ac-a037fc92718b for instance 48617155-accf-48c5-bb2c-877a4d09e9c2 on hv-cinder-81644 Dec 24 05:23:15.911218 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:23:15.911908 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.compute.api [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116330) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:23:15.912921 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [req-153249fc-09ce-44be-aff6-6871ed57baf8 req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093787 Dec 24 05:23:15.913523 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 756/1586] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Dec 24 05:23:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 24 05:23:15.918340 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:15.918800 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:15.919579 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:15.920006 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG oslo_concurrency.lockutils [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:15.979573 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.policy [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d8af7dfd114b88af9b6ca9e78381fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116330) authorize /opt/stack/nova/nova/policy.py:199}} Dec 24 05:23:15.987299 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-40d08bd9-f785-48fb-856d-9a97e7cb14fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 200 len: 1220 microversion: 2.1 time: 0.081268 Dec 24 05:23:15.987863 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 831/1587] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:23:15 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 24 05:23:17.008723 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '>' {{(pid=116329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:23:17.009764 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.compute.api [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] [instance: 48617155-accf-48c5-bb2c-877a4d09e9c2] Fetching instance by UUID {{(pid=116329) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 24 05:23:17.019529 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:17.020266 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:17.021571 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 05:23:17.022185 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG oslo_concurrency.lockutils [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Lock "9562cd56-697c-4a0e-b853-980571393783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 05:23:17.040234 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.wsgi [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] HTTP exception thrown: Instance 48617155-accf-48c5-bb2c-877a4d09e9c2 could not be found. Dec 24 05:23:17.040952 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: DEBUG nova.api.openstack.wsgi [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Returning 404 to user: Instance 48617155-accf-48c5-bb2c-877a4d09e9c2 could not be found. {{(pid=116329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 24 05:23:17.041804 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO nova.api.openstack.requestlog [None req-ab59836f-8752-4115-8445-c29e9e5e6ec1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2" status: 404 len: 111 microversion: 2.1 time: 0.039728 Dec 24 05:23:17.042330 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: [pid: 116329|app: 0|req: 757/1588] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Dec 24 05:23:17 2021] GET /compute/v2.1/servers/48617155-accf-48c5-bb2c-877a4d09e9c2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 24 05:23:17.209493 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: DEBUG nova.api.openstack.wsgi [None req-f655fda3-0514-45e2-b02f-18d04752e182 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling method '.version_select at 0x7f7baea00700>' {{(pid=116330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 24 05:23:17.235082 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO nova.api.openstack.requestlog [None req-f655fda3-0514-45e2-b02f-18d04752e182 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1151789464" status: 202 len: 0 microversion: 2.1 time: 0.029552 Dec 24 05:23:17.235845 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: [pid: 116330|app: 0|req: 832/1589] 10.222.0.43 () {58 vars in 1253 bytes} [Fri Dec 24 05:23:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1151789464 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 24 05:24:12.950232 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:24:12.951142 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:24:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:24:13.948163 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:24:13.949275 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:24:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:24:17.600896 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:24:17.602287 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:24:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:26:10.537890 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:26:10.538638 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:26:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:26:21.624325 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:26:21.625328 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:26:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:26:21.971348 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:26:21.971679 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:26:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:27:32.961431 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:27:32.963712 dv-cinder-816443-2-iscsi devstack@n-api.service[116330]: Fri Dec 24 05:27:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:27:33.961183 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:27:33.962255 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:27:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 24 05:27:37.615686 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 24 05:27:37.616915 dv-cinder-816443-2-iscsi devstack@n-api.service[116329]: Fri Dec 24 05:27:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!